-- Logs begin at Sun 2022-09-25 03:56:04 UTC, end at Sun 2022-09-25 04:56:27 UTC. -- Sep 25 04:21:14.461493 dv-cinder-855359-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 25 04:21:14.471704 dv-cinder-855359-5-smb devstack@keystone.service[81385]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 04:21:14 2022] *** Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: nodename: dv-cinder-855359-5-smb Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: machine: x86_64 Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: clock source: unix Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: pcre jit disabled Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: detected number of CPU cores: 4 Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: current working directory: / Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: detected binary path: /usr/bin/uwsgi-core Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: your processes number limit is 47680 Sep 25 04:21:14.473742 dv-cinder-855359-5-smb devstack@keystone.service[81385]: your memory page size is 4096 bytes Sep 25 04:21:14.474432 dv-cinder-855359-5-smb devstack@keystone.service[81385]: detected max file descriptor number: 2048 Sep 25 04:21:14.474432 dv-cinder-855359-5-smb devstack@keystone.service[81385]: lock engine: pthread robust mutexes Sep 25 04:21:14.474432 dv-cinder-855359-5-smb devstack@keystone.service[81385]: thunder lock: enabled Sep 25 04:21:14.474432 dv-cinder-855359-5-smb devstack@keystone.service[81385]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 25 04:21:14.474432 dv-cinder-855359-5-smb devstack@keystone.service[81385]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 04:21:14.513971 dv-cinder-855359-5-smb devstack@keystone.service[81385]: Python main interpreter initialized at 0x55cc7e82c9c0 Sep 25 04:21:14.513971 dv-cinder-855359-5-smb devstack@keystone.service[81385]: python threads support enabled Sep 25 04:21:14.513971 dv-cinder-855359-5-smb devstack@keystone.service[81385]: your server socket listen backlog is limited to 100 connections Sep 25 04:21:14.513971 dv-cinder-855359-5-smb devstack@keystone.service[81385]: your mercy for graceful operations on workers is 90 seconds Sep 25 04:21:14.514278 dv-cinder-855359-5-smb devstack@keystone.service[81385]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 04:21:14.514376 dv-cinder-855359-5-smb devstack@keystone.service[81385]: *** Operational MODE: preforking *** Sep 25 04:21:14.514629 dv-cinder-855359-5-smb devstack@keystone.service[81385]: *** uWSGI is running in multiple interpreter mode *** Sep 25 04:21:14.514629 dv-cinder-855359-5-smb devstack@keystone.service[81385]: spawned uWSGI master process (pid: 81385) Sep 25 04:21:14.514813 dv-cinder-855359-5-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 25 04:21:14.515867 dv-cinder-855359-5-smb devstack@keystone.service[81385]: spawned uWSGI worker 1 (pid: 81398, cores: 1) Sep 25 04:21:14.515867 dv-cinder-855359-5-smb devstack@keystone.service[81385]: spawned uWSGI worker 2 (pid: 81399, cores: 1) Sep 25 04:21:14.515867 dv-cinder-855359-5-smb devstack@keystone.service[81385]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 04:21:18.895582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:21:18.895582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: from cryptography.utils import int_from_bytes Sep 25 04:21:18.896353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:21:18.896353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: from cryptography.utils import int_from_bytes Sep 25 04:21:18.916884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:21:18.916884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Sep 25 04:21:18.917328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:21:18.917328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Sep 25 04:21:18.946399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 04:21:18.946596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 04:21:18.946792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] command line args: [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 04:21:18.947065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 04:21:18.947245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ================================================================================ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 04:21:18.947504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] admin_token = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.947752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config_dir = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.947942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.948128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config_source = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.948307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] debug = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.948509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.949885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.949885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.949885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.949885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.949885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.950210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_config_append = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.950210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.950326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_dir = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.950505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.950707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.950964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.951219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.951471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.951653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.951832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.952079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.952330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.952568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.952807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.953046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.953284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.953535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.953784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.954063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.954580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.954767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] publish_errors = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.955002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.955235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.955417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.955668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.955907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.956670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] standard_threads = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.956904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.957152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.957333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.957513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_journal = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.957691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_json = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.957869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_stderr = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.958047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_syslog = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.958279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.958570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.958820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.959085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.959330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.959584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.959827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.960078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.960317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.960571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.960822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.961074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.961310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.961561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.961801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.962052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.962302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.962569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.962831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.963090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.963337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.963577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.963835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.964101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.964357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.964610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.964846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.965081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.965316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.965556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.965796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 04:21:18.965934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.966058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 04:21:18.966171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.966288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] command line args: [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 04:21:18.966466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.966586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 04:21:18.966698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.966809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ================================================================================ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 04:21:18.966919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.967029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.967150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.967262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_dir = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.967373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.967483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.967593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.967710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_source = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.967710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] debug = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.967977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.968088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.968222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.968342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.968460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.968572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.968688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.968806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.968919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.969073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.969200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.969313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.969423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.969533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_config_append = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.969649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.969772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.969772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_dir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.969995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.970106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.970222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.970333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.970475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.970589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.970699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.970815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.970926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.971037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.971161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.971279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.971392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.971507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.971620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.972312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.972436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.972553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.972671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.972818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.972934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.973052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.973165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.973275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.973385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.973494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.973604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.973790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.973903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.974013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.974122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.974239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.974400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.974400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.974627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.974753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.974872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] publish_errors = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.974983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.975102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.975215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.975324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.975440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.975557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.975668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.975786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.975903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.976014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.976132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.976243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] standard_threads = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.976369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.976482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.976599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.976710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.976710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.976915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.977033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_journal = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.977145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.977256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_json = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.977373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.977489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_stderr = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.977489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_syslog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.977704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.977815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:21:18.977926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.978928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.979836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.980902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.981930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982040 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.982963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.983976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984198 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.external = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.984987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.password = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.985918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.token = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.986952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.987970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.988901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.989915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.990942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991764 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.991995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.992930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993198 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.993904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.994958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995659 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.995886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.996928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.997967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.998991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:18.999919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.000941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.001971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.002904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.external = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.003955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.password = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.token = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.004992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005345 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.005910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.006994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.007922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.008967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.009975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.010920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.011953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.012985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.013941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.014879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.015917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.016941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.017973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.018092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.018205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.018318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.020728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.021247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.021361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.021482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.021597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.021710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.021823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.021936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.022993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.023949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.024982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.025892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.026982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.027964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.028984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.029909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.030981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.031891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.032976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.033930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.034042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.034244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.034876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.034992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035374 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.035984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 04:21:19.036099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.036220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.036400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.036647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.036906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.037165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.037409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.037663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.037909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.038157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.038430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.038688 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.038929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.039188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.039443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.039696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.039953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.040207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.040460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.040712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.040964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.041202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.041457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.041710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.041962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.042215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.042650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.042895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.043152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.043411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.043667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.043924 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.044167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.044427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.044686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.044938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.045178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.045417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.045656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.045913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.046175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.046460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.046707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.046951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.047191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.047435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.047680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.047934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.048177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.048441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.048694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.048938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.049190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.049439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.049693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.049962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.050208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.050471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.050729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.051016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.051255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.051504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.051776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.052055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.052307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.052560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.052806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.053054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.053298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.053544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.053786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.054031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.054284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.054557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.054815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.055059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.055314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.055559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.055810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.056048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.056294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.056536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:21:19.056702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 04:21:19.065078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.065312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.065540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.073928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.082571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.082805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.083031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.091422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.102735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.102970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.110249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.110510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.156151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.157458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.205516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.205751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.206564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.206813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.362755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.362991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.363213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.363383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.363489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.363623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.363705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.363843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.363924 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.364065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.364290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.364512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.387544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.387775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.387859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.388946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.389081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.400602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.400758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.413434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.413617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.413846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.414072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.414290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.414531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.414747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.415865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.416105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.416336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.416565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.416791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.417011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.417229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 04:21:19.431679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.431890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 04:21:19.432239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.432440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 04:21:19.432717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.432983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.433248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.433509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.434625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.434938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 04:21:19.435378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.435583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 04:21:19.435864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.436130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.436393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.436652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.443894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.444181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.444454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.444738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.447921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.448210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.448489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.448781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.451712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.454640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.454930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.455220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.455512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.455801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.455880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.456626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.456941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.457197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.457470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.457745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.458016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.459396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.459690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.459977 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.460263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.460550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.460819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.461096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.461377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.461654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.461933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.462208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.480650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.482113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.482429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.487108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.487421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.487707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.487788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.489203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.489497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.494035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.494133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.494326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.494427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.494655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.499979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.500282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.500579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.500869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.501148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.501257 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.501427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.501554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.501708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.501981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.506085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.506403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.506701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.506993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.507276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.509291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.509586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.509875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.517891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.518178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.522578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.525747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.525999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.526091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.526286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.530180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.530262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.533352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.533446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.533655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.536662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.536966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.537259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.537548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.537830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.538077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.538157 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.541279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.544402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.544712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.545008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.545315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.545601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.546001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.553867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.554162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.554457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.554727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.561810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.562184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.562505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.562780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.563049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.563411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.564943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.565222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.568490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.568792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.569080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.569368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.569766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.570371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.572048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.573602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.573884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.576574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.576877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.577177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.577473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.577757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.580862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.581204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.581492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.581778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.582168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.582490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.582776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.589157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.589452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.589740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.590029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.590317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.590626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.590936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.598643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.601554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.604495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.605932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.606955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.607437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.607726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.608120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.610015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.613120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.614551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.614634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.616024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.616107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.616347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.616641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.618950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.619353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.619643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.619925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.623183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.624677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.627601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.627758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.627901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.628568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.628714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.628856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.629008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.635747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.636037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.636318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.636605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.636881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.637042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.637156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.637338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.637418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.637629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.637716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.637960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.638242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.638561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.638827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.639095 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.639366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.644679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 04:21:19.644971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.645258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.645545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.645826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.646104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.646417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.646702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.646991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.647267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.647553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.647821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.648143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.648420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 04:21:19.673730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cc7e82c9c0 pid: 81399 (default app) Sep 25 04:21:19.677499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529621f1-af2f-43fc-8018-a7606127f1ec None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:19.677790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529621f1-af2f-43fc-8018-a7606127f1ec None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:19.678066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529621f1-af2f-43fc-8018-a7606127f1ec None None] PATH_INFO: `/v3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:19.682222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Sun Sep 25 04:21:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:19.683451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cc7e82c9c0 pid: 81398 (default app) Sep 25 04:21:26.432738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e8470-55a6-4b6f-99e6-889eb06ed8f8 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:26.433249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e8470-55a6-4b6f-99e6-889eb06ed8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:26.433333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e8470-55a6-4b6f-99e6-889eb06ed8f8 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:26.434890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:26.442731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:26.443199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:26.443288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:26.513142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: INFO dbcounter [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] Registered counter for database keystone Sep 25 04:21:26.532446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG oslo_db.sqlalchemy.engines [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:21:26.539473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writer thread running {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:21:26.716429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 25 04:21:26.716814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 25 04:21:26.774107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:26.775686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:26.904035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1/3] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 25 04:21:27.327548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e8470-55a6-4b6f-99e6-889eb06ed8f8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:27.397444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: INFO dbcounter [None req-249e8470-55a6-4b6f-99e6-889eb06ed8f8 None None] Registered counter for database keystone Sep 25 04:21:27.418996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG oslo_db.sqlalchemy.engines [None req-249e8470-55a6-4b6f-99e6-889eb06ed8f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:21:27.425066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writer thread running {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:21:27.545237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e8470-55a6-4b6f-99e6-889eb06ed8f8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:27.549472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb6906-a4ce-465a-a654-76015f7fe7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:27.550675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb6906-a4ce-465a-a654-76015f7fe7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:27.550960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb6906-a4ce-465a-a654-76015f7fe7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:27.551232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb6906-a4ce-465a-a654-76015f7fe7f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:27.559644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb6906-a4ce-465a-a654-76015f7fe7f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:27.610590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9feb6906-a4ce-465a-a654-76015f7fe7f1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 25 04:21:27.610935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb6906-a4ce-465a-a654-76015f7fe7f1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:27.620734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1324 bytes} [Sun Sep 25 04:21:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 04:21:27.626701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:27.641542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14316c4a-e323-4a3f-ad7a-abf530fd776f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:27.645969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df695-ade4-4966-9647-f2564516d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:27.647116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df695-ade4-4966-9647-f2564516d9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:27.647400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df695-ade4-4966-9647-f2564516d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:27.647674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df695-ade4-4966-9647-f2564516d9fc admin admin] PATH_INFO: `/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:27.649113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df695-ade4-4966-9647-f2564516d9fc admin admin] RBAC: Authorizing `identity:get_project(project_id=38c69cf0e5d8493ba6bb16d3c4dd8b10)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:27.702126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f9df695-ade4-4966-9647-f2564516d9fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 25 04:21:27.702496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df695-ade4-4966-9647-f2564516d9fc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:27.707048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 2/5] 10.222.0.52 () {56 vars in 1207 bytes} [Sun Sep 25 04:21:27 2022] GET /identity/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:29.877760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab87ac-cd5e-49fd-ad53-52afcf3075f0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:29.878329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab87ac-cd5e-49fd-ad53-52afcf3075f0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:29.878329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab87ac-cd5e-49fd-ad53-52afcf3075f0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:29.882442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 4/6] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:29.887970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0227e9-3382-4f3d-927a-a4574ef15936 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:29.888365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0227e9-3382-4f3d-927a-a4574ef15936 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:29.888547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0227e9-3382-4f3d-927a-a4574ef15936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:29.908209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-de0227e9-3382-4f3d-927a-a4574ef15936 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:29.910231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-de0227e9-3382-4f3d-927a-a4574ef15936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:29.917961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 25 04:21:30.181762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab87ac-cd5e-49fd-ad53-52afcf3075f0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:30.194216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab87ac-cd5e-49fd-ad53-52afcf3075f0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:30.198480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89752ae-79b2-45e9-976b-59070135b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:30.199083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89752ae-79b2-45e9-976b-59070135b077 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:30.199365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89752ae-79b2-45e9-976b-59070135b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:30.199642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89752ae-79b2-45e9-976b-59070135b077 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:30.207771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89752ae-79b2-45e9-976b-59070135b077 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:30.209559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89752ae-79b2-45e9-976b-59070135b077 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:30.218187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1324 bytes} [Sun Sep 25 04:21:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:21:30.224145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0227e9-3382-4f3d-927a-a4574ef15936 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:30.233097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0227e9-3382-4f3d-927a-a4574ef15936 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:30.237438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6e3db-c5cc-4801-b3e7-11a794d1215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:30.238059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6e3db-c5cc-4801-b3e7-11a794d1215a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:30.238338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6e3db-c5cc-4801-b3e7-11a794d1215a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:30.238636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6e3db-c5cc-4801-b3e7-11a794d1215a admin admin] PATH_INFO: `/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:30.239943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6e3db-c5cc-4801-b3e7-11a794d1215a admin admin] RBAC: Authorizing `identity:get_user(user_id=5ce42dcf0646470a9a0e39f1ebd74dc0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:30.241763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6e3db-c5cc-4801-b3e7-11a794d1215a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:30.243299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 4/9] 10.222.0.52 () {56 vars in 1198 bytes} [Sun Sep 25 04:21:30 2022] GET /identity/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:32.421247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffe53a-2a63-485e-b7b8-f9e5325f6a02 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:32.421764 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffe53a-2a63-485e-b7b8-f9e5325f6a02 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:32.421870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffe53a-2a63-485e-b7b8-f9e5325f6a02 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:32.423153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:32.429019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98811fc-dfc5-45e6-90dc-33f61f2acf36 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:32.429432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98811fc-dfc5-45e6-90dc-33f61f2acf36 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:32.429638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98811fc-dfc5-45e6-90dc-33f61f2acf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:32.447759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e98811fc-dfc5-45e6-90dc-33f61f2acf36 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:32.448984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e98811fc-dfc5-45e6-90dc-33f61f2acf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:32.485366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c283a4-2b60-4d65-98be-b60442ed60a3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:32.485650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c283a4-2b60-4d65-98be-b60442ed60a3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:32.485929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c283a4-2b60-4d65-98be-b60442ed60a3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:32.487481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 7/11] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:21:32.492504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:32.492792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:32.493068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:32.531620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 5/12] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:32.535543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG passlib.handlers.bcrypt [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 25 04:21:32.535957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG passlib.handlers.bcrypt [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 25 04:21:32.584820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:32.586433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:32.684676 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 8/13] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:32.797097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98811fc-dfc5-45e6-90dc-33f61f2acf36 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:32.822631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:32.905502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98811fc-dfc5-45e6-90dc-33f61f2acf36 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:32.938487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:32.939130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:32.939417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:32.939694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:32.951132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:32.952670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:32.960189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:32.961267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:32.962381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 6/14] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:21:32.968893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:33.050518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:33.055370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463565a-1b02-456c-8f76-2316b13f293a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:33.057719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:33.069759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee50c99-a36b-456b-a7d8-694066b45011 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:33.096849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:33.098860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:33.099158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:33.099440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:33.105950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:33.106595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:33.106877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:33.107148 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:33.107824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:33.108126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:33.109524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:33.121843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 7/15] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:33.128316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:33.168642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:33.170183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:33.228289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2a2a-b3f0-4c43-ade1-be0c0a46e6ee None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:33.263510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:33.264153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:33.264431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:33.264710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] PATH_INFO: `/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:33.265849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] RBAC: Authorizing `identity:get_user(user_id=5ce42dcf0646470a9a0e39f1ebd74dc0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:33.267344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:33.268975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 8/16] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:33 2022] GET /identity/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:33.270017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:21:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:21:33.274603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:33.275429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:33.278219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:33.289538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:33.374779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87238201-9f2b-450a-884a-9f8d7bae172e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:33.378563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123fbd2-3b79-466e-ab86-2e5b0dfbb58b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:33.407798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:33.408660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:33.409026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:33.409305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:33.412935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:33.413574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:33.413859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:33.414140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:33.415310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:33.416786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:33.418440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:33.425313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:33.429181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:33.430760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:21:33.460295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:33.461210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:21:33.461970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:21:33.461970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:21:33.461970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:21:33.462627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:21:33.471247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:33.519875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:33.527467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:33.539899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63862ca-167f-419f-8589-cd2540451d6f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:33.573679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd5ab9-3b71-4169-9d61-db3c7c980650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:33.574294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5ab9-3b71-4169-9d61-db3c7c980650 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:33.574604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5ab9-3b71-4169-9d61-db3c7c980650 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:33.574706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102f3cf-3e15-4181-8bec-6e4fbce1ccf3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:33.574881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5ab9-3b71-4169-9d61-db3c7c980650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:33.575611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5ab9-3b71-4169-9d61-db3c7c980650 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.domain.id=default, user.id=5ce42dcf0646470a9a0e39f1ebd74dc0) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:33.575922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5ab9-3b71-4169-9d61-db3c7c980650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:33.577376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5ab9-3b71-4169-9d61-db3c7c980650 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:33.583883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1322 bytes} [Sun Sep 25 04:21:33 2022] GET /identity/v3/role_assignments?user.id=5ce42dcf0646470a9a0e39f1ebd74dc0&scope.domain.id=default&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:33.609932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6b4e7-58c8-4a71-9fb9-cf35a4845f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:33.610596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b4e7-58c8-4a71-9fb9-cf35a4845f20 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:33.610883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b4e7-58c8-4a71-9fb9-cf35a4845f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:33.611162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b4e7-58c8-4a71-9fb9-cf35a4845f20 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:33.611842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6b4e7-58c8-4a71-9fb9-cf35a4845f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:33.612753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6b4e7-58c8-4a71-9fb9-cf35a4845f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:33.614208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6b4e7-58c8-4a71-9fb9-cf35a4845f20 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:33.633251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:35.757648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2347-ea35-4d47-8c5d-f90702fc363f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:35.758176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2347-ea35-4d47-8c5d-f90702fc363f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:35.758176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2347-ea35-4d47-8c5d-f90702fc363f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:35.759552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:35.764935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa77b-f07f-4945-980f-3e7a70e25a3e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:35.765336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa77b-f07f-4945-980f-3e7a70e25a3e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:35.765496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa77b-f07f-4945-980f-3e7a70e25a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:35.791413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4f5fa77b-f07f-4945-980f-3e7a70e25a3e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:35.792715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4f5fa77b-f07f-4945-980f-3e7a70e25a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:35.880606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:36.407616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2347-ea35-4d47-8c5d-f90702fc363f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:36.425484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20013f9-9c26-4dc1-a1d3-a2a91cb85e44 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:36.426093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20013f9-9c26-4dc1-a1d3-a2a91cb85e44 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:36.426616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20013f9-9c26-4dc1-a1d3-a2a91cb85e44 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:36.428557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:36.437821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08cc5-8be3-401f-a5f2-bb42190f3a70 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:36.438419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08cc5-8be3-401f-a5f2-bb42190f3a70 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:36.438890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08cc5-8be3-401f-a5f2-bb42190f3a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:36.487856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8ea08cc5-8be3-401f-a5f2-bb42190f3a70 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:36.489412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8ea08cc5-8be3-401f-a5f2-bb42190f3a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:36.576245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:36.584930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2347-ea35-4d47-8c5d-f90702fc363f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:36.624567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 14/25] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:36.626180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e5b3-17c6-4775-9ba8-c1c1ae59735f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:36.626868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e5b3-17c6-4775-9ba8-c1c1ae59735f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:36.628622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e5b3-17c6-4775-9ba8-c1c1ae59735f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:36.630920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 15/26] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:36.636317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d118-9e1f-4dfb-a718-2fa95c5dff96 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:36.636836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d118-9e1f-4dfb-a718-2fa95c5dff96 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:36.637303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0d118-9e1f-4dfb-a718-2fa95c5dff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:36.654571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:36.655546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:36.656015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:36.656476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:36.669581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-afd0d118-9e1f-4dfb-a718-2fa95c5dff96 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:36.671825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-afd0d118-9e1f-4dfb-a718-2fa95c5dff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:36.676680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:36.682276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:36.683089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:36.683811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:36.686673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 12/27] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:36.700763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:36.712573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:36.844603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:36.904880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d9e2d-00cc-41df-827c-2b7bde214955 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:36.947800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c450688-037e-4061-b756-dd970f3c0e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:36.948776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c450688-037e-4061-b756-dd970f3c0e6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:36.949251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c450688-037e-4061-b756-dd970f3c0e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:36.949713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c450688-037e-4061-b756-dd970f3c0e6e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:36.950589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c450688-037e-4061-b756-dd970f3c0e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:36.951101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c450688-037e-4061-b756-dd970f3c0e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:36.952702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c450688-037e-4061-b756-dd970f3c0e6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:36.966005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 13/29] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:36.971172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0d118-9e1f-4dfb-a718-2fa95c5dff96 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:37.006448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82928-6b06-4ef9-90a1-e5eb9c6020e3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.007044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82928-6b06-4ef9-90a1-e5eb9c6020e3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.007541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82928-6b06-4ef9-90a1-e5eb9c6020e3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.009055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 14/30] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:21:37.013850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb7ab-72b9-4fb6-bf25-d49c7d1445dd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.014364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb7ab-72b9-4fb6-bf25-d49c7d1445dd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.014851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb7ab-72b9-4fb6-bf25-d49c7d1445dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.047317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-05cfb7ab-72b9-4fb6-bf25-d49c7d1445dd None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:37.048860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-05cfb7ab-72b9-4fb6-bf25-d49c7d1445dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:37.107363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0d118-9e1f-4dfb-a718-2fa95c5dff96 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:37.138772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:37.176250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:37.182472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:37.183183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.183474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.183759 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] PATH_INFO: `/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.187615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=5ce42dcf0646470a9a0e39f1ebd74dc0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:37.190099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:37.193277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 15/31] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:37.194119 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb7ab-72b9-4fb6-bf25-d49c7d1445dd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:37.198677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 17/32] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:36 2022] GET /identity/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:37.199547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:37.351110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7d47c-160d-4352-b5bb-947bfaf2c4e7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:37.389260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:37.389907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.390191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.390509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.392268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:37.393880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:37.395494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 18/33] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:37.396284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:37.458761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:37.515960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb7ab-72b9-4fb6-bf25-d49c7d1445dd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:37.534863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5dece-d89f-48d0-8bad-140cd525e6b7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:37.573622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:37.574733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.575493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.576177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.577188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:37.579381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:37.582729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:37.583372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.583655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.583925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.597576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:37.599889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:21:37.616358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:37.617473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:21:37.618487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:21:37.618487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:21:37.618487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:21:37.620307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 19/34] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:37.621281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:37.721705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 16/35] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Sep 25 04:21:37 2022] POST /identity/v3/roles => generated 219 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:21:37.723006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:37.747751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:37.756193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44885-a427-4ad6-b56f-026d730d3f05 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:37.794299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:37.794760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c121ab-c7d5-4034-8dc8-acb996f629cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:37.795464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c121ab-c7d5-4034-8dc8-acb996f629cd None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.795746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c121ab-c7d5-4034-8dc8-acb996f629cd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.796025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c121ab-c7d5-4034-8dc8-acb996f629cd None admin] PATH_INFO: `/v3/domains/default/users/5ce42dcf0646470a9a0e39f1ebd74dc0/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.798865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c121ab-c7d5-4034-8dc8-acb996f629cd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5ce42dcf0646470a9a0e39f1ebd74dc0, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:37.800503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c121ab-c7d5-4034-8dc8-acb996f629cd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:37.847591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0b2e-340e-42d1-a67f-045a872f96c9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:37.886162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:37.886828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.887114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.887390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.888076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:37.890028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:37.910495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 17/36] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Sep 25 04:21:37 2022] POST /identity/v3/roles => generated 225 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:21:37.910495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:37.924102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 20/37] 10.222.0.52 () {58 vars in 1361 bytes} [Sun Sep 25 04:21:37 2022] PUT /identity/v3/domains/default/users/5ce42dcf0646470a9a0e39f1ebd74dc0/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:21:37.926513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955201a-06ff-423e-8ce6-7954a379fca0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.926811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955201a-06ff-423e-8ce6-7954a379fca0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.927100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955201a-06ff-423e-8ce6-7954a379fca0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.932114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 21/38] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:37.933342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783262-83ba-4527-b7df-59c82bb423d0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.933588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783262-83ba-4527-b7df-59c82bb423d0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.933832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783262-83ba-4527-b7df-59c82bb423d0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.935622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 22/39] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:37.941885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7301-9e35-46f3-adb3-988a2fa204ad None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:37.942199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7301-9e35-46f3-adb3-988a2fa204ad None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:37.942502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7301-9e35-46f3-adb3-988a2fa204ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:37.968227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fadb7301-9e35-46f3-adb3-988a2fa204ad None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:37.970432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fadb7301-9e35-46f3-adb3-988a2fa204ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:38.060257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 23/40] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:38.062252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315427-ef5a-435c-a7e5-a54324cec2b4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:38.062802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315427-ef5a-435c-a7e5-a54324cec2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:38.063293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315427-ef5a-435c-a7e5-a54324cec2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:38.066194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd30c58-7c3b-40cb-b3cf-20154a4c3628 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:38.086280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e7315427-ef5a-435c-a7e5-a54324cec2b4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:38.086865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:38.088052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e7315427-ef5a-435c-a7e5-a54324cec2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:38.113704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:38.114590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:38.114968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:38.115810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:38.116334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:38.116710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:38.119699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:38.147627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 18/41] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:38.153856 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:38.183452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 24/42] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:38.276449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a2f9-73e9-4674-a485-39dae526dea6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:38.314085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:38.315470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:38.315904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:38.316419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:38.317265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:38.318909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:38.355517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 19/43] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:21:38 2022] POST /identity/v3/projects => generated 301 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:21:38.420360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315427-ef5a-435c-a7e5-a54324cec2b4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:38.438175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:38.471224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:38.502318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:38.544080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315427-ef5a-435c-a7e5-a54324cec2b4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:38.585612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:38.586294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:38.586673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:38.586946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:38.588062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:38.589644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:38.594485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 25/44] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:38.597057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:38.602635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304233-abaf-4e04-b379-31829759ccd5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:38.699724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:38.720507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5bcf5-559a-4045-b68b-8099b584053a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:38.748850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c7c6-4381-43ed-a0b1-10c87b265c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:38.749718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c7c6-4381-43ed-a0b1-10c87b265c46 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:38.750158 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c7c6-4381-43ed-a0b1-10c87b265c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:38.750471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c7c6-4381-43ed-a0b1-10c87b265c46 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:38.751165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c7c6-4381-43ed-a0b1-10c87b265c46 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:38.753152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c7c6-4381-43ed-a0b1-10c87b265c46 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:38.758093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b303e-b174-4ed5-86e2-e1e199c619f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:38.759058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b303e-b174-4ed5-86e2-e1e199c619f8 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:38.759429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b303e-b174-4ed5-86e2-e1e199c619f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:38.759753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b303e-b174-4ed5-86e2-e1e199c619f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:38.760521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b303e-b174-4ed5-86e2-e1e199c619f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:38.762244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b303e-b174-4ed5-86e2-e1e199c619f8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:38.770583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 20/45] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Sep 25 04:21:38 2022] POST /identity/v3/roles => generated 223 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:21:38.794741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 26/46] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:21:38 2022] POST /identity/v3/projects => generated 312 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:21:40.240097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d385ac-8993-47be-bacd-cbd8e754167c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:40.240609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d385ac-8993-47be-bacd-cbd8e754167c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:40.240713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d385ac-8993-47be-bacd-cbd8e754167c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:40.242003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 21/47] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:40.247244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f4ab-d3a6-4a8c-b047-088c2640f49b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:40.247639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f4ab-d3a6-4a8c-b047-088c2640f49b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:40.247795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f4ab-d3a6-4a8c-b047-088c2640f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:40.267912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f1e2f4ab-d3a6-4a8c-b047-088c2640f49b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:40.269610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f1e2f4ab-d3a6-4a8c-b047-088c2640f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:40.334216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 27/48] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:40.600297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d385ac-8993-47be-bacd-cbd8e754167c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:40.687376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:40.701152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d385ac-8993-47be-bacd-cbd8e754167c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:40.735270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:40.735913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:40.736200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:40.736499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:40.746892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:40.751828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:40.753394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:40.754250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 22/49] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:21:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:40.759294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2f4ab-d3a6-4a8c-b047-088c2640f49b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:40.819522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:40.859878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2f4ab-d3a6-4a8c-b047-088c2640f49b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:40.904729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ea9e-aeec-413f-89a4-9258158623aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:40.905346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ea9e-aeec-413f-89a4-9258158623aa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:40.905628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ea9e-aeec-413f-89a4-9258158623aa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:40.905899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ea9e-aeec-413f-89a4-9258158623aa None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:40.906595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ea9e-aeec-413f-89a4-9258158623aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:40.906899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ea9e-aeec-413f-89a4-9258158623aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:40.908282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ea9e-aeec-413f-89a4-9258158623aa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:40.920496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 28/50] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:40.926704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:40.982100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d9326-368f-4d65-8ab2-e63d78d21b72 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:40.982412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d9326-368f-4d65-8ab2-e63d78d21b72 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:40.982695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d9326-368f-4d65-8ab2-e63d78d21b72 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:40.984027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 29/51] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:40.988975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c961e8-c35c-4655-8aa1-806140fa8fcf None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:40.989262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c961e8-c35c-4655-8aa1-806140fa8fcf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:40.989536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c961e8-c35c-4655-8aa1-806140fa8fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:41.007727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a3c961e8-c35c-4655-8aa1-806140fa8fcf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:41.008922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a3c961e8-c35c-4655-8aa1-806140fa8fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:41.027028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f662-1b2e-4dcf-b3ae-cc5fa88672c6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:41.061427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:41.062078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:41.062384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:41.062662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] PATH_INFO: `/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:41.063872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] RBAC: Authorizing `identity:get_user(user_id=5ce42dcf0646470a9a0e39f1ebd74dc0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:41.065930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:41.067710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 23/52] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:40 2022] GET /identity/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:41.073590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:41.093267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:41.176217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296798-fc2c-4a98-a40d-aa6fb929ae07 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:41.178264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 30/53] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:41.210899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:41.211529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:41.211812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:41.212086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:41.213212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:41.214699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:41.216250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 24/54] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:41.221975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c961e8-c35c-4655-8aa1-806140fa8fcf None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:41.276731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:41.319839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c961e8-c35c-4655-8aa1-806140fa8fcf None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:41.351621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:41.352229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:41.352508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:41.352783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:41.353499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.domain.id=default, user.id=5ce42dcf0646470a9a0e39f1ebd74dc0) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:41.353805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:41.355262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:41.363357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 31/55] 10.222.0.52 () {56 vars in 1322 bytes} [Sun Sep 25 04:21:41 2022] GET /identity/v3/role_assignments?user.id=5ce42dcf0646470a9a0e39f1ebd74dc0&scope.domain.id=default&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:41.448588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:41.535568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:41.552572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3484-8087-4077-91a0-32f689a8f960 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:41.586834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7f4f-f6be-43c2-af76-a9b065891a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:41.587470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7f4f-f6be-43c2-af76-a9b065891a11 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:41.587749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7f4f-f6be-43c2-af76-a9b065891a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:41.588020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7f4f-f6be-43c2-af76-a9b065891a11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:41.589127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e7f4f-f6be-43c2-af76-a9b065891a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:41.590656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e7f4f-f6be-43c2-af76-a9b065891a11 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:41.592217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 25/56] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:41.598054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:41.697497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600a779-44f7-4b49-ba67-e15346aad94c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:41.716612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:41.730643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1407a-d541-48e9-8ece-4388ad53cf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:41.731253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1407a-d541-48e9-8ece-4388ad53cf86 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:41.731539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1407a-d541-48e9-8ece-4388ad53cf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:41.731816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1407a-d541-48e9-8ece-4388ad53cf86 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:41.732464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1407a-d541-48e9-8ece-4388ad53cf86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:41.733917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1407a-d541-48e9-8ece-4388ad53cf86 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:41.759430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 32/57] 10.222.0.52 () {60 vars in 1140 bytes} [Sun Sep 25 04:21:41 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:21:43.911982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b7ec5-76ee-437f-8d8c-b96146530e9e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:43.912498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b7ec5-76ee-437f-8d8c-b96146530e9e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:43.912498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b7ec5-76ee-437f-8d8c-b96146530e9e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:43.913859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 26/58] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:43.918992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8982-4ecc-4eed-b528-6a38b3179e14 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:43.919421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8982-4ecc-4eed-b528-6a38b3179e14 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:43.919550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8982-4ecc-4eed-b528-6a38b3179e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:43.937636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-154e8982-4ecc-4eed-b528-6a38b3179e14 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:43.938857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-154e8982-4ecc-4eed-b528-6a38b3179e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:44.002781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 33/59] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:44.269965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b7ec5-76ee-437f-8d8c-b96146530e9e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:44.367416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b7ec5-76ee-437f-8d8c-b96146530e9e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:44.401558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de224843-cc4c-4157-81a1-25cbefcf5ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:44.402188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de224843-cc4c-4157-81a1-25cbefcf5ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:44.402503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de224843-cc4c-4157-81a1-25cbefcf5ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:44.402783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de224843-cc4c-4157-81a1-25cbefcf5ad1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:44.403995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de224843-cc4c-4157-81a1-25cbefcf5ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:44.405457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de224843-cc4c-4157-81a1-25cbefcf5ad1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:44.407054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 27/60] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:44.412611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8982-4ecc-4eed-b528-6a38b3179e14 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:44.508253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8982-4ecc-4eed-b528-6a38b3179e14 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:44.509792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:44.542427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc39c6e-4140-4ccd-a59c-1c4d52d58c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:44.543033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc39c6e-4140-4ccd-a59c-1c4d52d58c1f None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:44.543316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc39c6e-4140-4ccd-a59c-1c4d52d58c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:44.543590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc39c6e-4140-4ccd-a59c-1c4d52d58c1f None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:44.544240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc39c6e-4140-4ccd-a59c-1c4d52d58c1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:44.545704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc39c6e-4140-4ccd-a59c-1c4d52d58c1f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:44.572715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 34/61] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:21:44 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:21:47.798000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5f2e-c6c2-4cf0-8018-5ce7f8dba179 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:47.798885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5f2e-c6c2-4cf0-8018-5ce7f8dba179 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:47.799351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5f2e-c6c2-4cf0-8018-5ce7f8dba179 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:47.801280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 28/62] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:47.806740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d210-1128-4815-9b51-286730796c36 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:47.807543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d210-1128-4815-9b51-286730796c36 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:47.807992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d210-1128-4815-9b51-286730796c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:47.835362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5755d210-1128-4815-9b51-286730796c36 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:47.836871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5755d210-1128-4815-9b51-286730796c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:47.916435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7e72-71f5-4675-b6cc-eea4581e7655 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:47.916777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7e72-71f5-4675-b6cc-eea4581e7655 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:47.916987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7e72-71f5-4675-b6cc-eea4581e7655 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:47.918608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 29/63] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:47.936251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b379c-eefc-4a4f-8405-96f99616b161 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:47.936872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b379c-eefc-4a4f-8405-96f99616b161 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:47.937357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b379c-eefc-4a4f-8405-96f99616b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:47.937456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 35/64] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:47.973257 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8a4b379c-eefc-4a4f-8405-96f99616b161 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:47.975198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8a4b379c-eefc-4a4f-8405-96f99616b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:47.998878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:48.073307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 30/65] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:48.226966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d210-1128-4815-9b51-286730796c36 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:48.322616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:48.336285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d210-1128-4815-9b51-286730796c36 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:48.389317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:48.389983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.390263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.390562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.391428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89395e-7196-4d4a-b233-577fc1d8cda8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.391922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89395e-7196-4d4a-b233-577fc1d8cda8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.392444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89395e-7196-4d4a-b233-577fc1d8cda8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.394706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 31/66] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:21:48.400431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2cea-8199-4bf0-98f7-3df3d49a110e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.400712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2cea-8199-4bf0-98f7-3df3d49a110e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.400975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2cea-8199-4bf0-98f7-3df3d49a110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.413212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:48.421516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:48.422413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:48.423173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:21:48.424820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 36/67] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:48.436179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:48.445060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0a7e2cea-8199-4bf0-98f7-3df3d49a110e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:48.446284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0a7e2cea-8199-4bf0-98f7-3df3d49a110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:48.522106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 32/68] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:48.524794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07447fe9-faaa-45bf-a798-05007ff0e408 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.525228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07447fe9-faaa-45bf-a798-05007ff0e408 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.525517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07447fe9-faaa-45bf-a798-05007ff0e408 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.530488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 33/69] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:48.530488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07447fe9-faaa-45bf-a798-05007ff0e408 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:48.561348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc1bb-75a7-4845-8b7b-91da80dd1099 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:48.596811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077423a7-2f28-46ab-bd01-c17e7999356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:48.597359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077423a7-2f28-46ab-bd01-c17e7999356f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.597635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077423a7-2f28-46ab-bd01-c17e7999356f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.597913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077423a7-2f28-46ab-bd01-c17e7999356f None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.598614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077423a7-2f28-46ab-bd01-c17e7999356f None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:48.598923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077423a7-2f28-46ab-bd01-c17e7999356f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:48.600315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077423a7-2f28-46ab-bd01-c17e7999356f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:48.608905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 37/70] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:21:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:48.615067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383d27-0635-43d0-a18b-2f5aaea07deb None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.615570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383d27-0635-43d0-a18b-2f5aaea07deb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.615690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383d27-0635-43d0-a18b-2f5aaea07deb None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.617099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 38/71] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:48.617909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6ae14-b025-4e1c-b7b0-9108e2c220bf None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.618188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6ae14-b025-4e1c-b7b0-9108e2c220bf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.618485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6ae14-b025-4e1c-b7b0-9108e2c220bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.623736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:48.637529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bba6ae14-b025-4e1c-b7b0-9108e2c220bf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:48.638763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bba6ae14-b025-4e1c-b7b0-9108e2c220bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:48.642264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:48.646111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07447fe9-faaa-45bf-a798-05007ff0e408 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:48.682135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:48.682800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.683095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.683374 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.694255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:48.699191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:48.700011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:48.700740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 34/72] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:48.702084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:48.722523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 39/73] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:48.723827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0e6b-9250-4ab7-adff-265a9563ebb5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.724193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0e6b-9250-4ab7-adff-265a9563ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.724478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0e6b-9250-4ab7-adff-265a9563ebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.751632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-112e0e6b-9250-4ab7-adff-265a9563ebb5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:48.752882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-112e0e6b-9250-4ab7-adff-265a9563ebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:48.823297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 40/74] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:48.825992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29256a2-72ef-45ac-992d-a41f9b5767de None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:48.828594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e0e6b-9250-4ab7-adff-265a9563ebb5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:48.863585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:48.864141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.864477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.864753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.876209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:48.880697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:48.882469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:48.884392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 35/75] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:48 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:48.884975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:48.920667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:48.956486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e0e6b-9250-4ab7-adff-265a9563ebb5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:48.989303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f3cd-04ae-4514-8018-edcd9d5acdea None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:48.992848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:48.993690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:48.994173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:48.994708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:48.995599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:48.996106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:48.997739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.006625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 41/76] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:49.007720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.024953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.025589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.025869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.026142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.036156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:49.041006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:49.041827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:21:49.042607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:49.046882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 36/77] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:21:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:49.047515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.105093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.116432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafea1a8-143a-45f9-a2c8-e77d6d87142b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.145205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.148763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd02394-31d5-4fd7-9b03-374502afb1df None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.150940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.151558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.151842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.152122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.186193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.187118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.187524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.187800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.188939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.190497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.192083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 37/78] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:49.192861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.222515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.224002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.293586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c15c66-2c7e-45f1-ba80-9c0b0b0686c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.318421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.322073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 42/79] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:21:49.322940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.332369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.333022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.333307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.333585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] PATH_INFO: `/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.334753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] RBAC: Authorizing `identity:get_user(user_id=5ce42dcf0646470a9a0e39f1ebd74dc0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.336202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.337776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 38/80] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:49.338567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.352926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.418814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b36a6-8844-4280-982f-facdd0ec925a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.437028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafad8e-8a90-4b8c-aa4f-f0812017d66a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.452323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.452925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.453212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.453483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.454140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:49.454469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.455936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.463546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 43/81] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:49.464323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.472779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.473541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.473831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.474113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.484201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:49.489687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:49.490783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 39/82] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:49.495190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.548550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.559076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.567612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a1047-92b5-4a81-ba55-4e0c49611855 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.595543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a684e7a-2e36-4997-ba1e-20370b78a769 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.600975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.601599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.601937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.602221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.602962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.604430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.625103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 44/83] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:21:49 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:21:49.626013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.629908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.630600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.630885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.631162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.632367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.633883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.635930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 40/84] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:49.641700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.741438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd309c-3fd4-4a41-8985-c051820bb9a5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.761362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf27a4-790e-4271-b56d-6fd676435413 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.778597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.779243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.779520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.779797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.786287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.801989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.802584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:49.802695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.802940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.803222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.804723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.806235 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.808085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 41/85] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:49.808638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.865749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.867850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.929444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d33-1390-46fc-87e7-91d6fc9b1e7e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:49.975332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:49.976169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:49.976561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:49.976945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:49.977515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:49.977824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:49.979259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:49.988795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 42/86] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:49.989640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:49.994980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 45/87] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:21:49.996122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:50.058802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:50.068962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:50.121763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdacd97-7e1f-46f7-a792-7d78f98fc57e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:50.132249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56de83b-3a5c-4771-ae81-22f3c5f616ad None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:50.164330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:50.165107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:50.165487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:50.165865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:50.166741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=e2282925fe014fdfbdea6895a6eb4c60) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:50.167157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:50.168701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:50.174741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 43/88] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/role_assignments?user.id=e2282925fe014fdfbdea6895a6eb4c60&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:50.175519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:50.177667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:50.178936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:50.179441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:50.179908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:50.314079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ef26-210c-44c7-afc4-6f2224cb5da6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:50.335143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:50.358886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:50.359955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:50.360435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:50.360915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:50.362772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:50.364733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:50.367042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 44/89] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:50 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:50.368130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:50.403392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:50.404890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:50.482036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1abe9c-2fec-4fa7-a67a-4df5b9453840 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:50.523547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:50.524665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:50.525509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:50.525997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:50.527381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:50.529050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:50.530931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 45/90] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:50 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:50.532342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:50.549920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:50.591186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:50.634070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 46/91] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:21:50.634929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:50.644143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468af3d-72b7-40a5-8d18-b75dd2cdf60e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:50.682092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:50.683083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:50.683559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:50.684042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:50.753915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:50.755780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:50.759223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d118-bdf1-4885-9b38-ba3df5b20067 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:50.804638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:50.805198 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:50.805483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:50.805761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:50.806539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=5ce42dcf0646470a9a0e39f1ebd74dc0) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:50.806854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:50.808356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:50.826021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 47/92] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:21:50 2022] GET /identity/v3/role_assignments?user.id=5ce42dcf0646470a9a0e39f1ebd74dc0&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:50.826907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:50.863271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:50.870739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:51.029694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 46/93] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:21:51.035771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:51.036950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bfdd9-166e-4927-93ee-a8ebb2f28005 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:51.093205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:51.093791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:51.094077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:51.094408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:51.095727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:51.097846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:51.099684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 48/94] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:50 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:51.119439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:51.164633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5b821-9db1-4334-a3ec-e5d2259bc9cb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:51.255188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:51.256215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:51.256691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:51.257157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] PATH_INFO: `/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:51.265190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] RBAC: Authorizing `identity:get_project(project_id=2d137ed1dbfa499dbc0cb2d4ca610fc2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:51.265190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:51.266642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 47/95] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:51 2022] GET /identity/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2 => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:51.273347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:51.280329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:51.315253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:51.326511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa674b-aa30-4093-adb3-5fa380a25ad7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:51.401261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d9e62-4637-4e44-a767-19cdafcac1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:51.401891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d9e62-4637-4e44-a767-19cdafcac1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:51.402180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d9e62-4637-4e44-a767-19cdafcac1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:51.402487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d9e62-4637-4e44-a767-19cdafcac1e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:51.403230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d9e62-4637-4e44-a767-19cdafcac1e0 None admin] RBAC: Adding query filter params (role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=e2282925fe014fdfbdea6895a6eb4c60) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:51.403543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d9e62-4637-4e44-a767-19cdafcac1e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:51.405003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d9e62-4637-4e44-a767-19cdafcac1e0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:51.420532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 49/96] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:21:51 2022] GET /identity/v3/role_assignments?user.id=e2282925fe014fdfbdea6895a6eb4c60&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:51.465306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bf37a-86b6-4063-971c-bf8cfae14116 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:51.522277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49404f-ec0f-49ac-a39d-57b16c5042bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:51.522934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49404f-ec0f-49ac-a39d-57b16c5042bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:51.523219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49404f-ec0f-49ac-a39d-57b16c5042bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:51.523497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49404f-ec0f-49ac-a39d-57b16c5042bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:51.524253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49404f-ec0f-49ac-a39d-57b16c5042bc None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=2d137ed1dbfa499dbc0cb2d4ca610fc2, user.id=e2282925fe014fdfbdea6895a6eb4c60) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:51.524602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49404f-ec0f-49ac-a39d-57b16c5042bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:51.526101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49404f-ec0f-49ac-a39d-57b16c5042bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:51.537324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 48/97] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:21:51 2022] GET /identity/v3/role_assignments?user.id=e2282925fe014fdfbdea6895a6eb4c60&scope.project.id=2d137ed1dbfa499dbc0cb2d4ca610fc2&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:52.847273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a10a-03ff-42b7-a240-30125b7fd4c5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:52.847784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a10a-03ff-42b7-a240-30125b7fd4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:52.847897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a10a-03ff-42b7-a240-30125b7fd4c5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:52.849336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 50/98] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:52.850965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bf725-f443-4d3b-9697-a7217b7c7bec None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:52.851332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bf725-f443-4d3b-9697-a7217b7c7bec None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:52.851525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bf725-f443-4d3b-9697-a7217b7c7bec None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:52.852992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 49/99] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:52.854769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b754-a598-4389-9929-01779406d4e4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:52.855059 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b754-a598-4389-9929-01779406d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:52.855336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b754-a598-4389-9929-01779406d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:52.867021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6aac-a6ca-425e-9335-fae14d3682d6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:52.867307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6aac-a6ca-425e-9335-fae14d3682d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:52.867588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6aac-a6ca-425e-9335-fae14d3682d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:52.894519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3059b754-a598-4389-9929-01779406d4e4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:52.895823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3059b754-a598-4389-9929-01779406d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:52.912756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-417d6aac-a6ca-425e-9335-fae14d3682d6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:52.913953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-417d6aac-a6ca-425e-9335-fae14d3682d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:53.036341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 50/100] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:53.037636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffa5a-3b2c-44d9-8e82-65b6dae112af None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:53.037930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffa5a-3b2c-44d9-8e82-65b6dae112af None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:53.038212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffa5a-3b2c-44d9-8e82-65b6dae112af None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:53.039757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 51/101] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:53.041438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 51/102] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:53.049960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b42ba-bb6d-49e7-b037-89bd5cc77900 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:53.050254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b42ba-bb6d-49e7-b037-89bd5cc77900 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:53.050567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b42ba-bb6d-49e7-b037-89bd5cc77900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:53.079332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ca0b42ba-bb6d-49e7-b037-89bd5cc77900 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:53.080601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ca0b42ba-bb6d-49e7-b037-89bd5cc77900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:53.091212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:53.188029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 52/103] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:53.509662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b754-a598-4389-9929-01779406d4e4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:53.633389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b42ba-bb6d-49e7-b037-89bd5cc77900 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:53.704487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:53.791353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b42ba-bb6d-49e7-b037-89bd5cc77900 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:53.828007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:53.829012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:53.829501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:53.829996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:53.831425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:53.832347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b754-a598-4389-9929-01779406d4e4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:53.833315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:53.835685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 53/104] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:53.836785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:53.857526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:53.984970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5e02-f8ee-4237-a1c2-c2e28b777181 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.016741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7ee2d-3bc3-4fb1-a3e9-a8d953a6f13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.017405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7ee2d-3bc3-4fb1-a3e9-a8d953a6f13b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.017980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7ee2d-3bc3-4fb1-a3e9-a8d953a6f13b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.018433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7ee2d-3bc3-4fb1-a3e9-a8d953a6f13b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.024221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.024958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.025315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.025687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.037057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:54.042196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:54.043126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:54.043859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 54/105] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:54.044533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.057338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7ee2d-3bc3-4fb1-a3e9-a8d953a6f13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-32d7ee2d-3bc3-4fb1-a3e9-a8d953a6f13b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:54.072691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:54.073535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:21:54.074312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:21:54.076748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 52/106] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 568 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:54.083194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef49fc-864d-4e97-b202-d5fc2a1713bc None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.083710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef49fc-864d-4e97-b202-d5fc2a1713bc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.084181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef49fc-864d-4e97-b202-d5fc2a1713bc None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.085635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 53/107] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:54.086556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef49fc-864d-4e97-b202-d5fc2a1713bc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.154697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:54.188845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a895f-9186-4435-bb56-25e10098cca8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.210577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef49fc-864d-4e97-b202-d5fc2a1713bc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.226125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c8f53-a736-48b2-915b-0b525a348b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.226792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c8f53-a736-48b2-915b-0b525a348b74 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.227071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c8f53-a736-48b2-915b-0b525a348b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.227361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c8f53-a736-48b2-915b-0b525a348b74 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.228018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c8f53-a736-48b2-915b-0b525a348b74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:54.229606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c8f53-a736-48b2-915b-0b525a348b74 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:54.249007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.249641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.249974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.250263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.251051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:54.251361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:54.252853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:54.255477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:54.262660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 54/108] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:21:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:54.263533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.266785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 55/109] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:21:54 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:21:54.270279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59df8-70c6-46a9-bc1a-0f65d1fcf86c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.270830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59df8-70c6-46a9-bc1a-0f65d1fcf86c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.271350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59df8-70c6-46a9-bc1a-0f65d1fcf86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.293339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-69a59df8-70c6-46a9-bc1a-0f65d1fcf86c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:54.295253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69a59df8-70c6-46a9-bc1a-0f65d1fcf86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:54.381863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 56/110] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:54.383434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a59df8-70c6-46a9-bc1a-0f65d1fcf86c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.450768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:54.484931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc590d6-6260-4e29-b466-5b819c7cf157 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.512334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a59df8-70c6-46a9-bc1a-0f65d1fcf86c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.524212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47529a-4e3d-4e63-a1fc-ed78ddccbc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.525224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47529a-4e3d-4e63-a1fc-ed78ddccbc2d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.525704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47529a-4e3d-4e63-a1fc-ed78ddccbc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.526177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47529a-4e3d-4e63-a1fc-ed78ddccbc2d None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.527088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47529a-4e3d-4e63-a1fc-ed78ddccbc2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:54.527677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47529a-4e3d-4e63-a1fc-ed78ddccbc2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:54.529374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47529a-4e3d-4e63-a1fc-ed78ddccbc2d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:54.538835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 55/111] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:21:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:54.540373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b86a-7071-40b1-95e2-279f83c1d9e9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.540857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b86a-7071-40b1-95e2-279f83c1d9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.541397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b86a-7071-40b1-95e2-279f83c1d9e9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.542960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 56/112] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:54.547497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b86a-7071-40b1-95e2-279f83c1d9e9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.550912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f455ad-e6ae-4399-930c-8dd3dbdf70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.551689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f455ad-e6ae-4399-930c-8dd3dbdf70e0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.551982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f455ad-e6ae-4399-930c-8dd3dbdf70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.552266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f455ad-e6ae-4399-930c-8dd3dbdf70e0 None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.553771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f455ad-e6ae-4399-930c-8dd3dbdf70e0 None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:54.555360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f455ad-e6ae-4399-930c-8dd3dbdf70e0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:54.557020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 57/113] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:54 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:54.558923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fe164-30bd-45b8-8f9a-d665c99ea184 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.559517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fe164-30bd-45b8-8f9a-d665c99ea184 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.560321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fe164-30bd-45b8-8f9a-d665c99ea184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.588078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-006fe164-30bd-45b8-8f9a-d665c99ea184 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:54.589713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-006fe164-30bd-45b8-8f9a-d665c99ea184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:54.619598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:54.672915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b86a-7071-40b1-95e2-279f83c1d9e9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.685062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 58/114] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:54.686340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fe164-30bd-45b8-8f9a-d665c99ea184 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.744261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:54.748085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fa663-192b-463b-854e-e2c10dd1cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.748815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fa663-192b-463b-854e-e2c10dd1cc1e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.749697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fa663-192b-463b-854e-e2c10dd1cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.750175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fa663-192b-463b-854e-e2c10dd1cc1e None admin] PATH_INFO: `/v3/users/aae0a89473fb4d298e5c6992376f32af` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.773632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fa663-192b-463b-854e-e2c10dd1cc1e None admin] RBAC: Authorizing `identity:get_user(user_id=aae0a89473fb4d298e5c6992376f32af)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:54.775281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fa663-192b-463b-854e-e2c10dd1cc1e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:54.777947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 57/115] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:54 2022] GET /identity/v3/users/aae0a89473fb4d298e5c6992376f32af => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:54.783552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d63ff2-83d8-4b20-95e0-a9495e40fadc None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.785297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d63ff2-83d8-4b20-95e0-a9495e40fadc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.785582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d63ff2-83d8-4b20-95e0-a9495e40fadc None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.787037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 58/116] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:54.787605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d63ff2-83d8-4b20-95e0-a9495e40fadc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.812064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fe164-30bd-45b8-8f9a-d665c99ea184 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.857534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.858279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.858548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.858830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.860176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:54.861518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:54.863236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 59/117] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:54 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:54.864013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:54.923161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d63ff2-83d8-4b20-95e0-a9495e40fadc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.950924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:54.974701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19122482-4a82-4da4-a9f3-5955ffcb3a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:54.975342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19122482-4a82-4da4-a9f3-5955ffcb3a0e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.975627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19122482-4a82-4da4-a9f3-5955ffcb3a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.975940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19122482-4a82-4da4-a9f3-5955ffcb3a0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:54.979182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8e821-5e36-41dd-bb4d-8c4c22945f0d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:54.990339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19122482-4a82-4da4-a9f3-5955ffcb3a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-19122482-4a82-4da4-a9f3-5955ffcb3a0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:54.995320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:54.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:21:54.996866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 59/118] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:54.998154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f41b11-2666-4fd1-a9ef-f07b731d8694 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:54.998154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f41b11-2666-4fd1-a9ef-f07b731d8694 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:54.998154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f41b11-2666-4fd1-a9ef-f07b731d8694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.006527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:55.015931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-02f41b11-2666-4fd1-a9ef-f07b731d8694 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:55.017141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-02f41b11-2666-4fd1-a9ef-f07b731d8694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:55.023342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.023962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.024244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.024517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.092963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 60/119] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:55.092963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f41b11-2666-4fd1-a9ef-f07b731d8694 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.107305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.109229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.187393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f41b11-2666-4fd1-a9ef-f07b731d8694 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.196526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:55.222821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.223603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 60/120] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:21:55.224849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.228058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.228358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.228647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276/users/e2282925fe014fdfbdea6895a6eb4c60/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.231582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] RBAC: Authorizing `identity:create_grant(project_id=66eaf3e7600546a0894142140cc8f276, user_id=e2282925fe014fdfbdea6895a6eb4c60, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.233063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.249663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 61/121] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:21:55 2022] PUT /identity/v3/projects/66eaf3e7600546a0894142140cc8f276/users/e2282925fe014fdfbdea6895a6eb4c60/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:21:55.250545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.251709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:55.368494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d50f3-0408-4eb2-8419-f24aff0ffa65 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.396796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1987ad-3d13-4e22-b4d7-1c91c8f3ae21 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.428882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.429535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.429817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.430098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.443414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:55.443735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.444322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.444602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.444878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.445556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:55.445861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.447311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:55.448632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:55.449432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:55.450593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 61/122] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:55.451540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.465603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 62/123] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:55.466614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.508045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:55.552918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:55.575380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5b222-1d46-4757-a11e-23ba641474af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.595489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1aac-197b-4524-9bd6-236b72118550 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.631682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.632328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.632551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.632661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.632877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.633197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.633479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.633757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.635188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.637124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.639036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 62/124] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:55.639745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.645796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:55.651372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:55.652208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:21:55.653186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 63/125] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:55.653781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.758271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:55.759991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5b92-7421-485a-ae36-c3f554bf545e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.768897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4074cc3-1830-4bb5-99b4-3d038a90530a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.797984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.798741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.799606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.799984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.800769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:55.801081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.802494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.805578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.806229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.806539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.806816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] PATH_INFO: `/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.808075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] RBAC: Authorizing `identity:get_user(user_id=5ce42dcf0646470a9a0e39f1ebd74dc0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.809538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.811768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 63/126] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:55.811950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 64/127] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:55.812132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.816691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.825534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:55.929371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af435-18a4-4489-a98a-23d2e6ca6750 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.929619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79473b-d5ea-4cf2-9aeb-48cc595b7ce6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:55.967088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.967685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.968021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.968302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.969150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] RBAC: Adding query filter params (role.id=cbfc30970313458f8c2e05941297b5cc, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=aae0a89473fb4d298e5c6992376f32af) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:55.969431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:55.969551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.970288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:55.970752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:55.971485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.971872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:55.972671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:55.973231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:55.974868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:55.977428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 64/128] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/role_assignments?user.id=aae0a89473fb4d298e5c6992376f32af&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=cbfc30970313458f8c2e05941297b5cc => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:55.978312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:55.984717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 65/129] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:55.985924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:56.011252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:56.101586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:56.152243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc68e83-f42d-48af-9023-3064ab78c6dd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:56.195030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086b63e-7ff1-4b33-9df6-00fbd351b89d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:56.218544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:56.219492 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.219915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.220332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.223421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:56.225332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:56.227793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 65/130] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:56.229150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:56.254803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:56.255678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.256306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.257477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.260090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:56.263367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:56.266322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 66/131] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:55 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:56.270491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:56.398073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:56.410368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ba1e-5c3e-4e5c-92b3-e64deb2ac3eb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:56.445785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:56.446398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.446684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.446968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276/users/5ce42dcf0646470a9a0e39f1ebd74dc0/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.449040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] RBAC: Authorizing `identity:create_grant(project_id=66eaf3e7600546a0894142140cc8f276, user_id=5ce42dcf0646470a9a0e39f1ebd74dc0, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:56.450549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:56.466749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 67/132] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:21:56 2022] PUT /identity/v3/projects/66eaf3e7600546a0894142140cc8f276/users/5ce42dcf0646470a9a0e39f1ebd74dc0/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:21:56.467789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:56.476489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a29f3-f603-485e-8f07-3f4b5878bd38 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:56.595806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:56.596506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.596832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.597116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.598309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:56.599848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:56.601810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 66/133] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:56 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:56.607432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:56.646731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:56.653256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea04e59-16fd-4242-9e47-a746898e182f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:56.710037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:56.710644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.710926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.711199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] PATH_INFO: `/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.715112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] RBAC: Authorizing `identity:get_project(project_id=2d137ed1dbfa499dbc0cb2d4ca610fc2)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:56.716611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:56.718507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 68/134] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:56 2022] GET /identity/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2 => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:56.724473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:56.750889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:56.841679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29761-44fc-454b-9d10-d9c0f389fd05 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:56.877685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702962a-2b9a-445a-93bc-3d4780e2a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:56.878391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702962a-2b9a-445a-93bc-3d4780e2a7d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.878660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702962a-2b9a-445a-93bc-3d4780e2a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.878938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702962a-2b9a-445a-93bc-3d4780e2a7d3 None admin] PATH_INFO: `/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2/users/e2282925fe014fdfbdea6895a6eb4c60/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.880867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702962a-2b9a-445a-93bc-3d4780e2a7d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d137ed1dbfa499dbc0cb2d4ca610fc2, user_id=e2282925fe014fdfbdea6895a6eb4c60, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:56.882325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702962a-2b9a-445a-93bc-3d4780e2a7d3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:56.902871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 69/135] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:21:56 2022] PUT /identity/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2/users/e2282925fe014fdfbdea6895a6eb4c60/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:21:56.920934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d5d7-a3b6-45b3-9110-d5157b82990d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:56.935874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457efd-9ba6-423f-aacb-c8ec18604a9e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.936175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457efd-9ba6-423f-aacb-c8ec18604a9e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.936440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457efd-9ba6-423f-aacb-c8ec18604a9e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.937914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 70/136] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:21:56.946026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b323-de80-4d7b-9df0-cde5af98cb97 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.946386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b323-de80-4d7b-9df0-cde5af98cb97 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.946635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b323-de80-4d7b-9df0-cde5af98cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.978076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f426b323-de80-4d7b-9df0-cde5af98cb97 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:56.979285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f426b323-de80-4d7b-9df0-cde5af98cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:56.987857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:56.988542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:56.988812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:56.989095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:56.990428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:56.991942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:56.993703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 67/137] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:56 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:21:57.000516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:57.130733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:57.131439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 71/138] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:57.169245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03d64f-4bba-45b9-8b71-4ec613a7d0d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:57.217988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:57.218690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:57.218969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:57.219247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276/users/e2282925fe014fdfbdea6895a6eb4c60/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:57.224238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] RBAC: Authorizing `identity:create_grant(project_id=66eaf3e7600546a0894142140cc8f276, user_id=e2282925fe014fdfbdea6895a6eb4c60, role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:57.225705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:57.242047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 68/139] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:21:56 2022] PUT /identity/v3/projects/66eaf3e7600546a0894142140cc8f276/users/e2282925fe014fdfbdea6895a6eb4c60/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:21:57.536539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b323-de80-4d7b-9df0-cde5af98cb97 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:57.545292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:57.653013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b323-de80-4d7b-9df0-cde5af98cb97 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:57.691074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67748520-9a20-4c50-9317-52e2d658c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:57.691718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748520-9a20-4c50-9317-52e2d658c014 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:57.692003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748520-9a20-4c50-9317-52e2d658c014 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:57.692280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748520-9a20-4c50-9317-52e2d658c014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:57.693405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67748520-9a20-4c50-9317-52e2d658c014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:57.695017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67748520-9a20-4c50-9317-52e2d658c014 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:57.696611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 72/140] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:21:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:57.702137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:57.824390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f1885-75c2-4771-836f-461c492d7e26 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:57.850116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7a1d-d769-43a3-92e1-2453a4170199 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:57.850782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7a1d-d769-43a3-92e1-2453a4170199 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:57.851258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7a1d-d769-43a3-92e1-2453a4170199 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:57.853052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 73/141] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:57.858285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053b66d-875d-4261-a0c9-3ee47ee69cae None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:57.858826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053b66d-875d-4261-a0c9-3ee47ee69cae None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:57.859447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053b66d-875d-4261-a0c9-3ee47ee69cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:57.863995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:57.864628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:57.864916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:57.865210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:57.865869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:57.874381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:57.890321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:57.901607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 69/142] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:21:57 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:21:57.902751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0053b66d-875d-4261-a0c9-3ee47ee69cae None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:57.904031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0053b66d-875d-4261-a0c9-3ee47ee69cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:58.010190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 74/143] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:21:58.533669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:58.648247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ac209-4bed-4e4b-8634-9ac51e6ed814 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:58.694740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:58.695395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:58.695679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:58.695955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:58.707627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:21:58.714680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:21:58.715493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:21:58.716293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 70/144] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:21:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:21:58.722972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053b66d-875d-4261-a0c9-3ee47ee69cae None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:58.726172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:58.828171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053b66d-875d-4261-a0c9-3ee47ee69cae None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:58.866027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:58.866681 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:58.866967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:58.867259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:58.867940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:58.868245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:58.869639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:58.878654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 75/145] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:21:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:58.884397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:58.950967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:59.000984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01799-10a5-4a18-9399-11b5a7503086 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:59.040473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ec004-2a6f-48d0-8658-2f82b2115f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:59.041126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec004-2a6f-48d0-8658-2f82b2115f93 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:59.041408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec004-2a6f-48d0-8658-2f82b2115f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:59.041684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec004-2a6f-48d0-8658-2f82b2115f93 None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:59.042871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ec004-2a6f-48d0-8658-2f82b2115f93 None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:59.044412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ec004-2a6f-48d0-8658-2f82b2115f93 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:59.046012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 71/146] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:21:58 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:59.052342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:59.124144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:59.160639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862f92-cca6-4479-ac4f-83659e8dc3f7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:59.196493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442397a5-7029-4051-8432-303f8eace596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:59.197115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442397a5-7029-4051-8432-303f8eace596 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:59.197396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442397a5-7029-4051-8432-303f8eace596 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:59.197675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442397a5-7029-4051-8432-303f8eace596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:59.227368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8af1-478d-4b2a-9824-06814135dc1a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:59.227660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8af1-478d-4b2a-9824-06814135dc1a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:59.227923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8af1-478d-4b2a-9824-06814135dc1a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:59.229347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 72/147] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:21:59.247743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da01b4-59af-4dab-b8b5-f1b06faea067 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:59.248046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da01b4-59af-4dab-b8b5-f1b06faea067 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:59.248298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da01b4-59af-4dab-b8b5-f1b06faea067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:59.278479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-66da01b4-59af-4dab-b8b5-f1b06faea067 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:21:59.279717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-66da01b4-59af-4dab-b8b5-f1b06faea067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:21:59.307128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442397a5-7029-4051-8432-303f8eace596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:59.309132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442397a5-7029-4051-8432-303f8eace596 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:59.390695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:59.414766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 73/148] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:21:59.429329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:21:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:21:59.434968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da01b4-59af-4dab-b8b5-f1b06faea067 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:59.499711 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:21:59.552848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da01b4-59af-4dab-b8b5-f1b06faea067 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:59.603986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:59.604645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:59.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:59.605198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:59.606373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:59.607858 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:59.609757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 74/150] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:21:59 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:21:59.616534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442397a5-7029-4051-8432-303f8eace596 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:21:59.738645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442397a5-7029-4051-8432-303f8eace596 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:21:59.788350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd92f5-c22b-4b8a-b47c-97f02bd61f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:21:59.789328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd92f5-c22b-4b8a-b47c-97f02bd61f7f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:21:59.789809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd92f5-c22b-4b8a-b47c-97f02bd61f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:21:59.790278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd92f5-c22b-4b8a-b47c-97f02bd61f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:21:59.791236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd92f5-c22b-4b8a-b47c-97f02bd61f7f None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=e2282925fe014fdfbdea6895a6eb4c60) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:21:59.791741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd92f5-c22b-4b8a-b47c-97f02bd61f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:21:59.793388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd92f5-c22b-4b8a-b47c-97f02bd61f7f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:21:59.802865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 77/151] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:21:59 2022] GET /identity/v3/role_assignments?user.id=e2282925fe014fdfbdea6895a6eb4c60&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:00.056133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:00.152707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa332e-2a2a-4bb3-9ecf-3b017a50ea22 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.153347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa332e-2a2a-4bb3-9ecf-3b017a50ea22 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.153832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa332e-2a2a-4bb3-9ecf-3b017a50ea22 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.155449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 78/152] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:00.167404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb245-5910-45b1-a145-289df40430be None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.168037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb245-5910-45b1-a145-289df40430be None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.168513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb245-5910-45b1-a145-289df40430be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.199929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879394bd-eeb3-4a29-923d-07962044a98a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:00.207059 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e15fb245-5910-45b1-a145-289df40430be None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:00.208656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e15fb245-5910-45b1-a145-289df40430be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:00.238721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:00.251306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:00.292045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:00.292714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.292993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.293265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.315473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:00.320386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:00.321254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:00.322422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 75/153] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:00.328741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 79/154] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:00.329534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:00.379734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40efda-351d-436d-859d-bf80daa104a0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.380055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40efda-351d-436d-859d-bf80daa104a0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.380289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40efda-351d-436d-859d-bf80daa104a0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.381858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 80/155] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:00.386951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659647-3355-4d34-9f55-832adc55edef None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.387230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659647-3355-4d34-9f55-832adc55edef None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.387570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659647-3355-4d34-9f55-832adc55edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.412266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b8659647-3355-4d34-9f55-832adc55edef None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:00.413814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b8659647-3355-4d34-9f55-832adc55edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:00.480414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367bd42-241a-4919-8c69-e78e173812f4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:00.494039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 81/156] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:00.535049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:00.535661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.535949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.536205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.536872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:00.537185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:00.538592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:00.547294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 76/157] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:00.552897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8659647-3355-4d34-9f55-832adc55edef None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:00.650425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:00.664625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8659647-3355-4d34-9f55-832adc55edef None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:00.707064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:00.707713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.707994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.708268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] PATH_INFO: `/v3/users/aae0a89473fb4d298e5c6992376f32af` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.709465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] RBAC: Authorizing `identity:get_user(user_id=aae0a89473fb4d298e5c6992376f32af)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:00.710995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:00.712876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 82/158] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:00 2022] GET /identity/v3/users/aae0a89473fb4d298e5c6992376f32af => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:00.718890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:00.789495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:00.866670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb5cf-8230-4a56-98f2-5580169209f3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:00.915158 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:00.915733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:00.916021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:00.916302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:00.917493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:00.919004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:00.920838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 77/159] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:00 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:00.926546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.038445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.128217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338b0d-6908-417b-bc97-c35a6cedc85d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:01.204587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa051f-f9dd-4b9a-acd6-f3a62294ee32 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:01.216109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:01.217679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:01.218635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.219150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.219655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276/users/aae0a89473fb4d298e5c6992376f32af/roles/cbfc30970313458f8c2e05941297b5cc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.222493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] RBAC: Authorizing `identity:create_grant(project_id=66eaf3e7600546a0894142140cc8f276, user_id=aae0a89473fb4d298e5c6992376f32af, role_id=cbfc30970313458f8c2e05941297b5cc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:01.224619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:01.251645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 83/160] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:00 2022] PUT /identity/v3/projects/66eaf3e7600546a0894142140cc8f276/users/aae0a89473fb4d298e5c6992376f32af/roles/cbfc30970313458f8c2e05941297b5cc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:01.253385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.261084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:01.261735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.262016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.262289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.285079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:01.295412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:01.296344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:01.297123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 78/161] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:01.306377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:01.306640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.436474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb35a-4589-4733-a3da-85dd79499320 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:01.477873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de81ca6-ad32-4aa4-a921-a2bb831ab051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:01.478448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81ca6-ad32-4aa4-a921-a2bb831ab051 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.478731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81ca6-ad32-4aa4-a921-a2bb831ab051 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.479008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81ca6-ad32-4aa4-a921-a2bb831ab051 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.479691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de81ca6-ad32-4aa4-a921-a2bb831ab051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:01.479994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de81ca6-ad32-4aa4-a921-a2bb831ab051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:01.481422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de81ca6-ad32-4aa4-a921-a2bb831ab051 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:01.508554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 79/162] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:01.509866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb7ef-af7f-4ab0-a6c7-3edb5963810c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:01.512692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7913-dbfe-4dda-9c53-6c6628c02358 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.513227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7913-dbfe-4dda-9c53-6c6628c02358 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.513764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7913-dbfe-4dda-9c53-6c6628c02358 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.515356 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 80/163] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:01.521177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb035-0448-4a4f-ae5d-6b50b179f0d7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.521720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb035-0448-4a4f-ae5d-6b50b179f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.522183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb035-0448-4a4f-ae5d-6b50b179f0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.567407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6dfcb035-0448-4a4f-ae5d-6b50b179f0d7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:01.568998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6dfcb035-0448-4a4f-ae5d-6b50b179f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:01.574653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:01.575307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.575585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.575855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.598380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:01.603162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:01.603333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:01.604165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:01.604920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 84/164] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:01.608602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.647256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 81/165] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:01.648230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcb035-0448-4a4f-ae5d-6b50b179f0d7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.752776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcb035-0448-4a4f-ae5d-6b50b179f0d7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:01.792226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:01.792902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.793206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.793477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.794197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:01.794525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:01.795906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:01.804886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 82/166] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:01.806656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:01.810973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.837382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:01.865035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dfc0d-8019-4ed5-ba7e-36dab6e21f6b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:01.913488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7773b2-7801-4831-ba1b-7313112f1dfe None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:01.949368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:01.950003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.950334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.950634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.951791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:01.953297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:01.954915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 83/167] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:01.960947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:01.975079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:01.975743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:01.976027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:01.976306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] PATH_INFO: `/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:01.977492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] RBAC: Authorizing `identity:get_user(user_id=5ce42dcf0646470a9a0e39f1ebd74dc0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:01.979012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:01.980941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 85/168] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/users/5ce42dcf0646470a9a0e39f1ebd74dc0 => generated 247 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:01.987902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:02.058893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:02.065854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651ee24-5425-4fcd-bc28-8fcb4d99447c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:02.101932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:02.102602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.102932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.103210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.173056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:02.174733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:02.233879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368ba3-3f6d-4e8a-b263-eb31c2b8f55c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:02.275027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:02.288950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 84/169] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:22:02.289706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:02.306888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:02.307754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.308173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.308650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.335428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:02.392912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13f21-d160-401b-b5f7-b5a6095ff9f0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:02.427385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:02.427809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:02.428445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.428724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.428997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.429788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:02.439785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:02.444998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:02.446132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:02.447377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 85/170] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:02.448016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:02.507196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:02.556728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96936b09-1274-45f1-9caa-223a6fd443b5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:02.591943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:02.592525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.592808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.593077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] PATH_INFO: `/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.594232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=2d137ed1dbfa499dbc0cb2d4ca610fc2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:02.595844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:02.597487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 86/171] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:02 2022] GET /identity/v3/projects/2d137ed1dbfa499dbc0cb2d4ca610fc2 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:02.598242 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:02.626491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 86/172] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:02.630620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:02.708308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf7709-2a60-4287-ae18-94ae7579d5f7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:02.721126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:02.728288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:02.744687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:02.745303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.745582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.745853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.749450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:02.749450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:02.749450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:02.757050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 87/173] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:02.757861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:02.831824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065df5-2eb9-4966-99e4-c0e8ebb42939 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:02.867001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13fa2f-17d3-4f93-bb2d-958448d3f2e5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:02.903197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:02.903826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.904151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.904426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.905175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=2d137ed1dbfa499dbc0cb2d4ca610fc2, user.id=e2282925fe014fdfbdea6895a6eb4c60) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:02.905484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:02.907025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:02.911996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f76e-6343-45cf-8c46-e03bd74db1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:02.912849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f76e-6343-45cf-8c46-e03bd74db1fd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.913269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f76e-6343-45cf-8c46-e03bd74db1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.913680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f76e-6343-45cf-8c46-e03bd74db1fd None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.916120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f76e-6343-45cf-8c46-e03bd74db1fd None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:02.917738 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f76e-6343-45cf-8c46-e03bd74db1fd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:02.921561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 88/174] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:02 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:02.923812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 87/175] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:02 2022] GET /identity/v3/role_assignments?user.id=e2282925fe014fdfbdea6895a6eb4c60&scope.project.id=2d137ed1dbfa499dbc0cb2d4ca610fc2&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:02.925521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:02.926271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f3de1-1501-4b3a-a105-14fb8262f45b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:02.927131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f3de1-1501-4b3a-a105-14fb8262f45b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:02.927547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f3de1-1501-4b3a-a105-14fb8262f45b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:02.929473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 89/176] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:02.936882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f3de1-1501-4b3a-a105-14fb8262f45b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:03.075905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:03.080589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c49ed3-d2ec-430e-824a-e844cdc16bba None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:03.095012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:03.129054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4093ad-00ee-4b00-99f4-d01a60521f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:03.130061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4093ad-00ee-4b00-99f4-d01a60521f63 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.131013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4093ad-00ee-4b00-99f4-d01a60521f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.131453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4093ad-00ee-4b00-99f4-d01a60521f63 None admin] PATH_INFO: `/v3/users/e2282925fe014fdfbdea6895a6eb4c60` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.133976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4093ad-00ee-4b00-99f4-d01a60521f63 None admin] RBAC: Authorizing `identity:get_user(user_id=e2282925fe014fdfbdea6895a6eb4c60)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:03.137014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4093ad-00ee-4b00-99f4-d01a60521f63 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:03.138951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 88/177] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:02 2022] GET /identity/v3/users/e2282925fe014fdfbdea6895a6eb4c60 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:03.141234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0603960-be8a-4a2d-b2c4-3ef1a8b0f9fb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.141697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0603960-be8a-4a2d-b2c4-3ef1a8b0f9fb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.142120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0603960-be8a-4a2d-b2c4-3ef1a8b0f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.164447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e0603960-be8a-4a2d-b2c4-3ef1a8b0f9fb None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:03.166246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e0603960-be8a-4a2d-b2c4-3ef1a8b0f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:03.208617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f3de1-1501-4b3a-a105-14fb8262f45b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:03.247017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d07c-ab39-472e-ae69-ab15a6085b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:03.248052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d07c-ab39-472e-ae69-ab15a6085b88 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.248484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d07c-ab39-472e-ae69-ab15a6085b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.249180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d07c-ab39-472e-ae69-ab15a6085b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.250432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d07c-ab39-472e-ae69-ab15a6085b88 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=5ce42dcf0646470a9a0e39f1ebd74dc0) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:03.250904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d07c-ab39-472e-ae69-ab15a6085b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:03.252693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d07c-ab39-472e-ae69-ab15a6085b88 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:03.253086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 89/178] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:03.256144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01268b4-0880-4c2f-9294-9de890366875 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.256144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01268b4-0880-4c2f-9294-9de890366875 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.256144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01268b4-0880-4c2f-9294-9de890366875 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.256144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 90/179] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:03.256814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01268b4-0880-4c2f-9294-9de890366875 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:03.284403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 90/180] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:02 2022] GET /identity/v3/role_assignments?user.id=5ce42dcf0646470a9a0e39f1ebd74dc0&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:03.285678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8935e-88c3-427c-a14d-e8460e8508d0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.285965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8935e-88c3-427c-a14d-e8460e8508d0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.286234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8935e-88c3-427c-a14d-e8460e8508d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.324215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4fc8935e-88c3-427c-a14d-e8460e8508d0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:03.327261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4fc8935e-88c3-427c-a14d-e8460e8508d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:03.424862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 91/181] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:03.491063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01268b4-0880-4c2f-9294-9de890366875 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:03.504443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:03.537010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95164dd3-347a-479a-90cc-678a5c5f468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:03.537666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164dd3-347a-479a-90cc-678a5c5f468e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.537975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164dd3-347a-479a-90cc-678a5c5f468e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.538224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164dd3-347a-479a-90cc-678a5c5f468e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.622470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95164dd3-347a-479a-90cc-678a5c5f468e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:03.623955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95164dd3-347a-479a-90cc-678a5c5f468e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:03.707889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8935e-88c3-427c-a14d-e8460e8508d0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:03.743060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 91/182] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:03.745452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98a0a8-1066-4bd4-89b8-a0b7968f6ed4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.745797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98a0a8-1066-4bd4-89b8-a0b7968f6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.746005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98a0a8-1066-4bd4-89b8-a0b7968f6ed4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.747310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 92/183] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:03.750932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98a0a8-1066-4bd4-89b8-a0b7968f6ed4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:03.766543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:03.791735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:03.860688 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8935e-88c3-427c-a14d-e8460e8508d0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:03.871714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98a0a8-1066-4bd4-89b8-a0b7968f6ed4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:03.896791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:03.897426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.897708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.897982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.906502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f0645-a78c-4e17-a1b4-e5ae06deebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:03.907126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f0645-a78c-4e17-a1b4-e5ae06deebe9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.907401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f0645-a78c-4e17-a1b4-e5ae06deebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.907673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f0645-a78c-4e17-a1b4-e5ae06deebe9 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.909085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:03.909578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f0645-a78c-4e17-a1b4-e5ae06deebe9 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:03.911108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f0645-a78c-4e17-a1b4-e5ae06deebe9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:03.912886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 93/184] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:03 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:03.913769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4c71-1e0f-4225-8d0c-6c091bf2993e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:03.914048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4c71-1e0f-4225-8d0c-6c091bf2993e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:03.914145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:03.914986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:03.915992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:03.916570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4c71-1e0f-4225-8d0c-6c091bf2993e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:03.916649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 92/185] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:03.916649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:03.933977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b4ba4c71-1e0f-4225-8d0c-6c091bf2993e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:03.935440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b4ba4c71-1e0f-4225-8d0c-6c091bf2993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:04.002457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 94/186] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:04.003241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba4c71-1e0f-4225-8d0c-6c091bf2993e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.013594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.044519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfc797-30d6-463e-90c8-49cba8929106 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.047014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.090835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.091623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.091996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.092366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.103083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:04.108820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:04.110661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:04.116430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 93/187] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:04.117791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba4c71-1e0f-4225-8d0c-6c091bf2993e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.118238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.160090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.160845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.161183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.161521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.162386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] RBAC: Adding query filter params (role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=e2282925fe014fdfbdea6895a6eb4c60) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:04.162781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.164301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.171036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 95/188] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/role_assignments?user.id=e2282925fe014fdfbdea6895a6eb4c60&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:04.171927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.278371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8486fa8-5921-4373-8709-68bddd424ced None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.299148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.319170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.319806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.320089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.320368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.321071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:04.321377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.323005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.333338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 94/189] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:04.334301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.339631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cdb0a-0e33-4ef7-8a28-7d4b78512c17 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.372378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.382070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.382920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.383277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.383623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.384391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:04.384770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.386336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.396589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 96/190] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:04.398888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.472286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e75d86-f15b-415f-b039-e4010bca6442 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.526278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.526951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.527234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.527513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.528636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.529709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eca29-09db-4eeb-a163-1bb859873337 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.530085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.531858 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 95/191] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:04.532469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.567621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.574181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.574862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.575147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.575444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] PATH_INFO: `/v3/users/ed923ca9b4c34102a1acbcd72ee33452` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.591516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed923ca9b4c34102a1acbcd72ee33452)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.593074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.595003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 97/192] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/users/ed923ca9b4c34102a1acbcd72ee33452 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:04.596125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.636506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.647053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a274-9d8c-46f5-bfa3-26f5343e7a6d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.702096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.702839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.703294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.703759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] PATH_INFO: `/v3/users/ed923ca9b4c34102a1acbcd72ee33452` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.705555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] RBAC: Authorizing `identity:get_user(user_id=ed923ca9b4c34102a1acbcd72ee33452)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.708016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.715320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 96/193] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/users/ed923ca9b4c34102a1acbcd72ee33452 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:04.715320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.718504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dfc0c-958b-4a95-9430-29ea51fa02d8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.757313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f9777-15f4-4124-abf2-71c2839491a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.757912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f9777-15f4-4124-abf2-71c2839491a4 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.758190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f9777-15f4-4124-abf2-71c2839491a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.758490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f9777-15f4-4124-abf2-71c2839491a4 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.759139 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f9777-15f4-4124-abf2-71c2839491a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.760571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f9777-15f4-4124-abf2-71c2839491a4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.780655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 98/194] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:04 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:04.783749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad98e6-4e18-4f25-9da4-c8d2839a96ea None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.784094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad98e6-4e18-4f25-9da4-c8d2839a96ea None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.784381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad98e6-4e18-4f25-9da4-c8d2839a96ea None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.786387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 99/195] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:04.786659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad98e6-4e18-4f25-9da4-c8d2839a96ea None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:04.826658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b424-5328-42ba-9d40-7dbdc1305e54 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.849813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.866592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fd14a-4802-4e6d-b0a5-71e60771be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.867223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fd14a-4802-4e6d-b0a5-71e60771be7a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.867503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fd14a-4802-4e6d-b0a5-71e60771be7a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.867780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fd14a-4802-4e6d-b0a5-71e60771be7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:04.901523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:04.920250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad98e6-4e18-4f25-9da4-c8d2839a96ea None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:04.944668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fd14a-4802-4e6d-b0a5-71e60771be7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:04.946171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fd14a-4802-4e6d-b0a5-71e60771be7a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:04.962727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:04.963457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:04.963750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:04.964011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.048471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:05.050622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:05.076123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 97/196] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:05.077429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25af0-ccc6-4a82-8f33-515b57fe5879 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:05.077785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25af0-ccc6-4a82-8f33-515b57fe5879 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:05.078249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25af0-ccc6-4a82-8f33-515b57fe5879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.102702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4ec25af0-ccc6-4a82-8f33-515b57fe5879 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:05.103918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4ec25af0-ccc6-4a82-8f33-515b57fe5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:05.108009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:05.171759 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 100/197] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:05.173487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:05.176463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:05.183946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 98/198] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:05.185087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec25af0-ccc6-4a82-8f33-515b57fe5879 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:05.304166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97faf-ee50-4517-b522-5735d61683c9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:05.321228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec25af0-ccc6-4a82-8f33-515b57fe5879 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:05.371496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:05.372140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:05.372417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:05.372691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.374473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:05.377329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:05.379194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 101/199] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:05 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:05.387295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:05.403299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:05.403943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:05.404220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:05.404505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.405625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:05.407088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:05.409388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 99/200] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:05 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:05.421509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:05.423097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:05.509603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eb48a-6c95-4214-a75b-b40121f1b27e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:05.531932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:05.549319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:05.549937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:05.550216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:05.550526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.551268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=ed923ca9b4c34102a1acbcd72ee33452) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:05.551578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:05.553088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:05.559578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 102/201] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:05 2022] GET /identity/v3/role_assignments?user.id=ed923ca9b4c34102a1acbcd72ee33452&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:05.560570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:05.583572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b8788-87f2-43de-b78c-7dee51456a08 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:05.643311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:05.643948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:05.644229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:05.644508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.645269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] RBAC: Adding query filter params (role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=ed923ca9b4c34102a1acbcd72ee33452) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:05.649725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:05.651293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:05.666829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 100/202] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:05 2022] GET /identity/v3/role_assignments?user.id=ed923ca9b4c34102a1acbcd72ee33452&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:05.686804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:05.728079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d1344-c3c6-44d3-a74f-719a448ca60b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:05.775047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:05.775760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:05.776043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:05.776368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.791022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:05.796775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:05.797699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:05.798503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:05.802130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 103/203] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:05.804440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:05.938675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0377a-da4e-4bd6-ad98-1119fd93a83b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:05.966414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:05.978979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:05.979905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:05.980380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:05.980847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:05.981741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:05.982254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:05.983854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:05.993526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 101/204] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:05.999102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:06.144075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a385-9f2a-43ac-98f6-7919c8032df6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:06.188306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:06.189090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:06.189305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:06.189520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] PATH_INFO: `/v3/users/aae0a89473fb4d298e5c6992376f32af` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:06.190716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=aae0a89473fb4d298e5c6992376f32af)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:06.192164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:06.194041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 104/205] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:05 2022] GET /identity/v3/users/aae0a89473fb4d298e5c6992376f32af => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:06.199511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:06.343847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f08e0-a5b9-46fc-b9ad-4d984867c147 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:06.387591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:06.388221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:06.388506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:06.388778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:06.460485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:06.477788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:06.479321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:06.599299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 102/206] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:06.605197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:06.619530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:06.781093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48112c3-5862-4211-9811-44a6c5eb4cf5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:06.824164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c7ee6-a2cc-418b-8dbc-c986c6c89a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:06.824833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7ee6-a2cc-418b-8dbc-c986c6c89a8c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:06.825117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7ee6-a2cc-418b-8dbc-c986c6c89a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:06.825393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7ee6-a2cc-418b-8dbc-c986c6c89a8c None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:06.826612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c7ee6-a2cc-418b-8dbc-c986c6c89a8c None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:06.828107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c7ee6-a2cc-418b-8dbc-c986c6c89a8c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:06.829882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 105/207] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:06 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:06.836780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:06.947443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:06.968060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701525e-2d8c-4006-b2b5-58090214f80a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:07.011213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536453b8-d86e-4fa4-ae7b-f4dece44512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:07.011827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536453b8-d86e-4fa4-ae7b-f4dece44512f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:07.012106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536453b8-d86e-4fa4-ae7b-f4dece44512f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:07.012377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536453b8-d86e-4fa4-ae7b-f4dece44512f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:07.013111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536453b8-d86e-4fa4-ae7b-f4dece44512f None admin] RBAC: Adding query filter params (role.id=cbfc30970313458f8c2e05941297b5cc, scope.project.id=66eaf3e7600546a0894142140cc8f276, user.id=aae0a89473fb4d298e5c6992376f32af) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:07.013417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536453b8-d86e-4fa4-ae7b-f4dece44512f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:07.014902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536453b8-d86e-4fa4-ae7b-f4dece44512f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:07.020950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 103/208] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:06 2022] GET /identity/v3/role_assignments?user.id=aae0a89473fb4d298e5c6992376f32af&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=cbfc30970313458f8c2e05941297b5cc => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:07.472685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc950-7980-4586-a973-af81a261a1b4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:07.473616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc950-7980-4586-a973-af81a261a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:07.474068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc950-7980-4586-a973-af81a261a1b4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:07.475681 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 106/209] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:07.481674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a92a03-b535-401c-9c5e-6db782f00ab5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:07.482270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a92a03-b535-401c-9c5e-6db782f00ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:07.482763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a92a03-b535-401c-9c5e-6db782f00ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:07.504219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-55a92a03-b535-401c-9c5e-6db782f00ab5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:07.505751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-55a92a03-b535-401c-9c5e-6db782f00ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:07.577108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 104/210] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:07.606618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060333d4-9ff1-4ad4-9a0d-3a762511fefa None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:07.607166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060333d4-9ff1-4ad4-9a0d-3a762511fefa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:07.607636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060333d4-9ff1-4ad4-9a0d-3a762511fefa None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:07.609172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 107/211] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:07.614728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1098-2bf7-4aad-9ebb-7377f9c417cb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:07.615212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1098-2bf7-4aad-9ebb-7377f9c417cb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:07.615638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1098-2bf7-4aad-9ebb-7377f9c417cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:07.634462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-194f1098-2bf7-4aad-9ebb-7377f9c417cb None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:07.635864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-194f1098-2bf7-4aad-9ebb-7377f9c417cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:07.706833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 105/212] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:07.877879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060333d4-9ff1-4ad4-9a0d-3a762511fefa None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:07.964734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:07.983286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1098-2bf7-4aad-9ebb-7377f9c417cb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:07.993622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060333d4-9ff1-4ad4-9a0d-3a762511fefa None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:07.995938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:08.029389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:08.030025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.030302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.030601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.031723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:08.033716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:08.035326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 108/213] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:08.040787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:08.108675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1098-2bf7-4aad-9ebb-7377f9c417cb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:08.156839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:08.157694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.158709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.159107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9405a8-40a2-4344-86a8-d7865fe15493 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:08.159255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.174010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:08.180796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:08.181684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:08.182485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 106/214] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:08.188098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:08.204976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b9b89-acef-447f-89c1-fbed315043b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:08.205788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b9b89-acef-447f-89c1-fbed315043b9 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.206180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b9b89-acef-447f-89c1-fbed315043b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.206648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b9b89-acef-447f-89c1-fbed315043b9 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.207486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b9b89-acef-447f-89c1-fbed315043b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:08.209268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b9b89-acef-447f-89c1-fbed315043b9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:08.231502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:08.241237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 109/215] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:08 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:22:08.297188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:08.326552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8c37-f589-429d-a809-bc1214d9c463 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.327212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8c37-f589-429d-a809-bc1214d9c463 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.327714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8c37-f589-429d-a809-bc1214d9c463 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.329302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 110/216] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:08.331083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099bda-ef04-4429-8185-14875d5c14ef None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.331808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099bda-ef04-4429-8185-14875d5c14ef None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.332575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099bda-ef04-4429-8185-14875d5c14ef None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.334816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 111/217] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:08.336448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c5be-6819-4562-9099-1adef59f1ca3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.336953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c5be-6819-4562-9099-1adef59f1ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.337240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c5be-6819-4562-9099-1adef59f1ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.346872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7c3b-7e1f-4c1a-b3f1-15b151e1a1a2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:08.357028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c830c5be-6819-4562-9099-1adef59f1ca3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:08.358281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c830c5be-6819-4562-9099-1adef59f1ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:08.384500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586a967-940e-44b0-ac07-8c0bd7b0e92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:08.385139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a967-940e-44b0-ac07-8c0bd7b0e92e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.385418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a967-940e-44b0-ac07-8c0bd7b0e92e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.385689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a967-940e-44b0-ac07-8c0bd7b0e92e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.386401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586a967-940e-44b0-ac07-8c0bd7b0e92e None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:08.386710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586a967-940e-44b0-ac07-8c0bd7b0e92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:08.388127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586a967-940e-44b0-ac07-8c0bd7b0e92e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:08.397208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 107/218] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:08.398419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc1ab-8043-41a8-8bcf-914a7e86fee6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.398709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc1ab-8043-41a8-8bcf-914a7e86fee6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.398985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc1ab-8043-41a8-8bcf-914a7e86fee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.417731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-99ecc1ab-8043-41a8-8bcf-914a7e86fee6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:08.418908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-99ecc1ab-8043-41a8-8bcf-914a7e86fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:08.434493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 112/219] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:08.438506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c5be-6819-4562-9099-1adef59f1ca3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:08.500156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 108/220] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:08.558570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c5be-6819-4562-9099-1adef59f1ca3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:08.594235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:08.598124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:08.598806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.599192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.599529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] PATH_INFO: `/v3/users/dd8875aa4dec476abafb236b61cb67df` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.614761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] RBAC: Authorizing `identity:get_user(user_id=dd8875aa4dec476abafb236b61cb67df)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:08.616213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:08.618018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 113/221] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:08 2022] GET /identity/v3/users/dd8875aa4dec476abafb236b61cb67df => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:08.623502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecc1ab-8043-41a8-8bcf-914a7e86fee6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:08.690279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:08.706701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:08.739082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecc1ab-8043-41a8-8bcf-914a7e86fee6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:08.779935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:08.780554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.780833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.781107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.855735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ad5e-4612-4905-a2e2-244ed7f0561d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:08.868005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:08.869766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:08.892840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:08.893522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:08.893838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:08.894116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:08.906339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:08.911981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:08.912844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:08.914024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 114/222] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:08.914900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:08.944137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:08.965543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:08.994674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 109/223] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:08.995381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.026648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35087-998a-4893-b8f2-f2171bf83ea4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.067623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.068689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.069199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.069685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.082122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:09.087459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:09.088329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:09.089099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:09.096635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 115/224] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:09.097834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.113643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8148f8c-052f-4abb-bfe5-d714c8c66418 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.154518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.155487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.155959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.156442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.157296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:09.157871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.160041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.169109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 110/225] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:09.170337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.197016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:09.220677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1a1b4-f090-4d96-8802-eae99f28c9a2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.231645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:09.267679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.268488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.268863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.269234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.270528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.272250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.274156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 116/226] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:09 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:09.275104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.305761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f9911-4c1f-4998-a145-8a7cebe05709 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.356087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.357438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.357883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.358334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.359882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:09.360341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.363635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.375901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 111/227] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:09.377045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.387346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed315a35-d0c5-47eb-b917-b183a80f86aa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.428475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.429656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.429656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.429973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] PATH_INFO: `/v3/users/ed923ca9b4c34102a1acbcd72ee33452` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.431277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] RBAC: Authorizing `identity:get_user(user_id=ed923ca9b4c34102a1acbcd72ee33452)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.432948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.435119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 117/228] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:09 2022] GET /identity/v3/users/ed923ca9b4c34102a1acbcd72ee33452 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:09.435967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.492227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:09.496381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:09.511422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f8ce-685f-4f83-bc8b-9a882ec4b408 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.556482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.557458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.558172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.558880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.560007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=dd8875aa4dec476abafb236b61cb67df) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:09.560470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.561092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87c7b-22ed-4043-87bf-61fab0f72f65 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.562581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.570484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 112/229] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:09 2022] GET /identity/v3/role_assignments?user.id=dd8875aa4dec476abafb236b61cb67df&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:09.571829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.600067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.600861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.601232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.601600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] PATH_INFO: `/v3/users/ed923ca9b4c34102a1acbcd72ee33452` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.602953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] RBAC: Authorizing `identity:get_user(user_id=ed923ca9b4c34102a1acbcd72ee33452)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.604587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.606932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 118/230] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:09 2022] GET /identity/v3/users/ed923ca9b4c34102a1acbcd72ee33452 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:09.612538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.711582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a19ea-4f03-4f83-a1d1-b75a46d55e40 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.755954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.756897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.757350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.757776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.759952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.761663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.764431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 113/231] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:09 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:09.770722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.806771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216ee75-7995-44bf-86d7-d68d8a0b5e41 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:09.814608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:09.822774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:09.849219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:09.850537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:09.850993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:09.851412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:09.852974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:09.854783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:09.856579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 119/232] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:09 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:09.862299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:09.976430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fff14-23ca-4d04-946c-cef00ed6647b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:10.016845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37be4d-ccec-4e03-aa7b-73aa5163a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:10.018255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37be4d-ccec-4e03-aa7b-73aa5163a9b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:10.018709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37be4d-ccec-4e03-aa7b-73aa5163a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:10.019149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37be4d-ccec-4e03-aa7b-73aa5163a9b1 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/ed923ca9b4c34102a1acbcd72ee33452/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:10.022113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37be4d-ccec-4e03-aa7b-73aa5163a9b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e15a2ad7c24db684dfaf7ae0391696, user_id=ed923ca9b4c34102a1acbcd72ee33452, role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:10.023761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37be4d-ccec-4e03-aa7b-73aa5163a9b1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:10.034413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f0ffc-2687-43a0-8f21-9c9711b477e6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:10.051848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 120/233] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:09 2022] PUT /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/ed923ca9b4c34102a1acbcd72ee33452/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:22:10.074841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7da8e-53b7-4107-8e73-3cbae2e6f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:10.075768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7da8e-53b7-4107-8e73-3cbae2e6f86c None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:10.076236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7da8e-53b7-4107-8e73-3cbae2e6f86c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:10.076705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7da8e-53b7-4107-8e73-3cbae2e6f86c None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/ed923ca9b4c34102a1acbcd72ee33452/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:10.078834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7da8e-53b7-4107-8e73-3cbae2e6f86c None admin] RBAC: Authorizing `identity:create_grant(project_id=89e15a2ad7c24db684dfaf7ae0391696, user_id=ed923ca9b4c34102a1acbcd72ee33452, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:10.081075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7da8e-53b7-4107-8e73-3cbae2e6f86c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:10.098987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 114/234] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:09 2022] PUT /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/ed923ca9b4c34102a1acbcd72ee33452/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:10.960258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bcc8a-05be-4be0-9eff-a645cf6126a4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:10.961156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bcc8a-05be-4be0-9eff-a645cf6126a4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:10.961579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bcc8a-05be-4be0-9eff-a645cf6126a4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:10.963110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 121/235] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:10.968555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72561e-5bd2-4377-8d63-df295cbbcd81 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:10.969016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72561e-5bd2-4377-8d63-df295cbbcd81 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:10.969439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72561e-5bd2-4377-8d63-df295cbbcd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:10.994222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1e72561e-5bd2-4377-8d63-df295cbbcd81 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:10.995665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1e72561e-5bd2-4377-8d63-df295cbbcd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:11.080922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 115/236] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:11.125831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5aca-543f-4561-b9a0-0c552e2722cb None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:11.126372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5aca-543f-4561-b9a0-0c552e2722cb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:11.127353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5aca-543f-4561-b9a0-0c552e2722cb None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:11.128840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 122/237] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:11.134190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38580d6-b5d4-4453-98ca-8a4b568f6f50 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:11.134654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38580d6-b5d4-4453-98ca-8a4b568f6f50 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:11.135144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38580d6-b5d4-4453-98ca-8a4b568f6f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:11.156850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b38580d6-b5d4-4453-98ca-8a4b568f6f50 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:11.158819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b38580d6-b5d4-4453-98ca-8a4b568f6f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:11.161334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:11.261868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 116/238] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:11.538325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be5aca-543f-4561-b9a0-0c552e2722cb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:11.569262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38580d6-b5d4-4453-98ca-8a4b568f6f50 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:11.592799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:11.711994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be5aca-543f-4561-b9a0-0c552e2722cb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:11.731597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38580d6-b5d4-4453-98ca-8a4b568f6f50 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:11.775539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:11.776189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:11.776471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:11.776747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:11.779319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:11.780790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:11.782407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 123/239] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:11.795925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:11.798718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:11.799826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:11.800309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:11.800778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:11.821892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:11.830721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:11.841905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:11.842836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:11.843589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 117/240] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:11.848974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:12.009363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bd337-e758-4fb9-83e6-7ff4c125b7a7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:12.022670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:12.032714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fccf1-367c-466d-839b-337ea3533ef2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:12.073829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:12.074400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.074684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.074960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.075632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:12.077136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:12.106338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03aefc-83e7-470d-9d30-8a743c6b4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:12.107012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03aefc-83e7-470d-9d30-8a743c6b4251 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.107380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03aefc-83e7-470d-9d30-8a743c6b4251 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.107662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03aefc-83e7-470d-9d30-8a743c6b4251 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.108826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03aefc-83e7-470d-9d30-8a743c6b4251 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:12.109130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03aefc-83e7-470d-9d30-8a743c6b4251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:12.110752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03aefc-83e7-470d-9d30-8a743c6b4251 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:12.121414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 124/241] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:11 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:12.133948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 118/242] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:12.135824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:12.306703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812085d-2e82-4955-b9cb-48e29b951c7b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:12.331643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4870062-205f-49f2-a7bf-863c2ce97d4d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.331914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4870062-205f-49f2-a7bf-863c2ce97d4d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.332108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4870062-205f-49f2-a7bf-863c2ce97d4d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.333455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 119/243] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:12.338960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ceb96-e702-4bd6-b16f-e2ca90d8536b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.339239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ceb96-e702-4bd6-b16f-e2ca90d8536b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.339506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ceb96-e702-4bd6-b16f-e2ca90d8536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.356399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:12.357139 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.357423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.357885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] PATH_INFO: `/v3/users/e311a535628a423baf4bbc01ce3b5137` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.361988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d25ceb96-e702-4bd6-b16f-e2ca90d8536b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:12.364207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d25ceb96-e702-4bd6-b16f-e2ca90d8536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:12.373629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e311a535628a423baf4bbc01ce3b5137)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:12.375446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:12.377461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 125/244] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:12 2022] GET /identity/v3/users/e311a535628a423baf4bbc01ce3b5137 => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:12.385108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:12.413868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:12.445772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:12.464173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 120/245] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:12.511609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d76a4e-2d75-47b1-943a-c074032376c2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:12.555725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7651f0-9c40-4a78-b5d7-d982a750c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:12.556339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7651f0-9c40-4a78-b5d7-d982a750c81b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.556618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7651f0-9c40-4a78-b5d7-d982a750c81b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.556888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7651f0-9c40-4a78-b5d7-d982a750c81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.652577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7651f0-9c40-4a78-b5d7-d982a750c81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:12.654084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7651f0-9c40-4a78-b5d7-d982a750c81b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:12.679521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:12.728465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7815-83ee-4dad-8df9-9423db43fd57 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.728763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7815-83ee-4dad-8df9-9423db43fd57 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.729026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7815-83ee-4dad-8df9-9423db43fd57 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.730574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 121/246] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:12.738271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df6fe-1cd5-4d00-9574-f4186b914f92 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.738875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df6fe-1cd5-4d00-9574-f4186b914f92 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.739378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df6fe-1cd5-4d00-9574-f4186b914f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.765044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-195df6fe-1cd5-4d00-9574-f4186b914f92 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:12.766963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-195df6fe-1cd5-4d00-9574-f4186b914f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:12.770854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 126/247] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:12.774389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e7bd-2f3d-4d91-9230-d0e75c3070a7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:12.774389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e7bd-2f3d-4d91-9230-d0e75c3070a7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:12.774389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e7bd-2f3d-4d91-9230-d0e75c3070a7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:12.774389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 127/248] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:12.779328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69e7bd-2f3d-4d91-9230-d0e75c3070a7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:12.858370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 122/249] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:12.859273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195df6fe-1cd5-4d00-9574-f4186b914f92 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:12.919707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69e7bd-2f3d-4d91-9230-d0e75c3070a7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:12.959207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:12.993070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195df6fe-1cd5-4d00-9574-f4186b914f92 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:13.000014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01072976-334c-4fa3-a3df-4b54237a3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.000677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072976-334c-4fa3-a3df-4b54237a3cca None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.000964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072976-334c-4fa3-a3df-4b54237a3cca None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.006851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072976-334c-4fa3-a3df-4b54237a3cca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.017645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:13.028244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01072976-334c-4fa3-a3df-4b54237a3cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:13.028714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.029320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.029596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.029865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-01072976-334c-4fa3-a3df-4b54237a3cca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:13.033308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:13.034165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:13.034972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 128/250] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:13.036072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb77fd9-b5bb-48e2-b252-3ff2c0c9af37 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.036072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb77fd9-b5bb-48e2-b252-3ff2c0c9af37 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.036353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:13.036493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb77fd9-b5bb-48e2-b252-3ff2c0c9af37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.037684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:13.043703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 123/251] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:12 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:13.044517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.058986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0eb77fd9-b5bb-48e2-b252-3ff2c0c9af37 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:13.060536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0eb77fd9-b5bb-48e2-b252-3ff2c0c9af37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:13.158535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 129/252] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:13.159457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb77fd9-b5bb-48e2-b252-3ff2c0c9af37 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.186943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78135a4-ca50-4b00-a26b-df10690f79bf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:13.228302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.228919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.229196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.229463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.230135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:13.230458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:13.231842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:13.245127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 124/253] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:13.252130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.350643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb77fd9-b5bb-48e2-b252-3ff2c0c9af37 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:13.350836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:13.368447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:13.414907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.415588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.415873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.416147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.416883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] RBAC: Adding query filter params (role.id=cbfc30970313458f8c2e05941297b5cc, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=e311a535628a423baf4bbc01ce3b5137) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:13.417191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:13.418673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:13.430392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 130/254] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/role_assignments?user.id=e311a535628a423baf4bbc01ce3b5137&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=cbfc30970313458f8c2e05941297b5cc => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:13.432548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.468786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eac5d8-6b0b-4cae-8970-596bc2d6e1ed None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:13.566466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fc936-190a-40c1-8149-4337251459ab None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:13.575772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.576445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.576730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.577004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] PATH_INFO: `/v3/users/dd8875aa4dec476abafb236b61cb67df` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.578204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8875aa4dec476abafb236b61cb67df)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:13.579810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:13.581793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 125/255] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/users/dd8875aa4dec476abafb236b61cb67df => generated 297 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:13.582639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.612504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.613177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.613620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.613907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.626269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:13.633496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:13.634458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:13.635240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 131/256] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:13.636378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.675566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:13.798314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5097c5-4418-48bd-b13a-a12732853441 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:13.816988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:13.818332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a2229-ab87-4dcd-9013-8dad455f029b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:13.836187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.836828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.837111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.837388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.848752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:13.854333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:13.855191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:13.855965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 126/257] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:13.856581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.911036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:13.912069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:13.912545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:13.913009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:13.919023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:13.920722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:13.922606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 132/258] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:13.924091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:13.965439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4bd5d-6745-4b28-aa9c-806b462327c6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:14.000751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:14.001373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:14.001720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:14.002000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:14.002813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:14.003121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:14.004524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:14.013513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 127/259] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:14.016293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:14.057461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:14.118828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970b3b5-f873-41e1-b0c1-81dcb849f572 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:14.154278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:14.155114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:14.155604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:14.155999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/dd8875aa4dec476abafb236b61cb67df/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:14.158590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e15a2ad7c24db684dfaf7ae0391696, user_id=dd8875aa4dec476abafb236b61cb67df, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:14.160313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:14.160822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d3d1-7ce2-49ba-ae1a-b37f420f39ad None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:14.162870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:14.178563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 128/260] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:14 2022] PUT /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/dd8875aa4dec476abafb236b61cb67df/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:14.180275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:14.292439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:14.293483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:14.293961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:14.294459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:14.295331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:14.295856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:14.300168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:14.315234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:14.320285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c078d48-1f94-4f23-be32-6812e8ed6e94 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:14.322688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 133/261] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:14.330090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:14.396582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:14.397703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:14.398220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:14.398718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] PATH_INFO: `/v3/users/ed923ca9b4c34102a1acbcd72ee33452` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:14.400367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed923ca9b4c34102a1acbcd72ee33452)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:14.402147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:14.405150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 129/262] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:14 2022] GET /identity/v3/users/ed923ca9b4c34102a1acbcd72ee33452 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:14.411438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:14.541223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3b13d-c63e-4b48-afb6-84721d948df1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:14.589796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb786f5f-a8ee-4781-a3ec-83731d81d0d8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:14.590085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:14.590849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:14.591133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:14.591408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] PATH_INFO: `/v3/users/ed923ca9b4c34102a1acbcd72ee33452` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:14.592714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] RBAC: Authorizing `identity:get_user(user_id=ed923ca9b4c34102a1acbcd72ee33452)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:14.594429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:14.596716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 134/263] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:14 2022] GET /identity/v3/users/ed923ca9b4c34102a1acbcd72ee33452 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:14.602254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:14.640490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:14.641172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:14.641457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:14.641732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:14.647977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:14.720834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:14.758425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:14.759929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:14.799473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654c10-5227-4adf-a6cd-4cdfc7ab8580 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:14.888254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 130/264] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:22:14.888456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:14.889082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:14.889365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:14.889641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:14.889871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:14.971142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:15.017100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f7e4a-a1c5-4a3c-909c-92f74c6e6661 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:15.065244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:15.066882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:15.088321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794457de-87f1-4462-99d4-241954b22811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:15.088968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794457de-87f1-4462-99d4-241954b22811 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.089251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794457de-87f1-4462-99d4-241954b22811 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.089526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794457de-87f1-4462-99d4-241954b22811 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.090860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794457de-87f1-4462-99d4-241954b22811 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:15.092319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794457de-87f1-4462-99d4-241954b22811 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:15.094124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 131/265] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:14 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:15.107338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794457de-87f1-4462-99d4-241954b22811 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:15.143457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:15.226741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794457de-87f1-4462-99d4-241954b22811 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:15.255031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 135/266] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:15.261950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da01e8-d17c-4f1f-beb7-3d5a60a0e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:15.262605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da01e8-d17c-4f1f-beb7-3d5a60a0e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.262890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da01e8-d17c-4f1f-beb7-3d5a60a0e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.263168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da01e8-d17c-4f1f-beb7-3d5a60a0e2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.263912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da01e8-d17c-4f1f-beb7-3d5a60a0e2d7 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=ed923ca9b4c34102a1acbcd72ee33452) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:15.264224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da01e8-d17c-4f1f-beb7-3d5a60a0e2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:15.265743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da01e8-d17c-4f1f-beb7-3d5a60a0e2d7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:15.269607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:15.270765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:15.276306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 132/267] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:15 2022] GET /identity/v3/role_assignments?user.id=ed923ca9b4c34102a1acbcd72ee33452&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:15.321176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeefc4-677b-4a26-a419-3bc80916b393 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.321777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeefc4-677b-4a26-a419-3bc80916b393 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.321777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeefc4-677b-4a26-a419-3bc80916b393 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.327161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 133/268] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:15.328467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca697-fb71-4ce2-9383-345afc215e05 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.328754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca697-fb71-4ce2-9383-345afc215e05 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.329034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca697-fb71-4ce2-9383-345afc215e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.363536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9b8ca697-fb71-4ce2-9383-345afc215e05 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:15.364832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b8ca697-fb71-4ce2-9383-345afc215e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:15.404407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c761ef-9602-406a-8ea0-2f46c45a19f2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:15.455152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:15.459672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:15.460339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.460626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.460910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.462310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:15.465501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:15.468823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 136/269] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:15 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:15.476363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:15.511821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 134/270] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:15.625185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea88e34-e7e8-4265-8d1f-6433a30e9224 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:15.675438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f21674-0bec-4479-abdf-13f97758d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:15.675973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21674-0bec-4479-abdf-13f97758d468 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.676254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21674-0bec-4479-abdf-13f97758d468 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.676527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21674-0bec-4479-abdf-13f97758d468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.677269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f21674-0bec-4479-abdf-13f97758d468 None admin] RBAC: Adding query filter params (role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=ed923ca9b4c34102a1acbcd72ee33452) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:15.677581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f21674-0bec-4479-abdf-13f97758d468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:15.679056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f21674-0bec-4479-abdf-13f97758d468 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:15.687419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 137/271] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:15 2022] GET /identity/v3/role_assignments?user.id=ed923ca9b4c34102a1acbcd72ee33452&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:15.770534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa3e9-bbfa-44ab-92ab-32be654fe7d5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.770868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa3e9-bbfa-44ab-92ab-32be654fe7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.771096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa3e9-bbfa-44ab-92ab-32be654fe7d5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.772682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 135/272] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:15.778530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa3dd-05d0-4181-a217-7e6299eaf931 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:15.778808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa3dd-05d0-4181-a217-7e6299eaf931 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:15.779085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa3dd-05d0-4181-a217-7e6299eaf931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:15.807589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f35fa3dd-05d0-4181-a217-7e6299eaf931 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:15.808829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f35fa3dd-05d0-4181-a217-7e6299eaf931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:15.881322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:15.897325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 138/273] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:15.944988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aa3e9-bbfa-44ab-92ab-32be654fe7d5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:16.062114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aa3e9-bbfa-44ab-92ab-32be654fe7d5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:16.099125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:16.106106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:16.107054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.107542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.108013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.122197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:16.127743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:16.128596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:16.129372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:16.132396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 136/274] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:16.138445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa3dd-05d0-4181-a217-7e6299eaf931 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:16.230869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:16.262265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa3dd-05d0-4181-a217-7e6299eaf931 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:16.304343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:16.305429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.305918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.306290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.307097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:16.307516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:16.309205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:16.319218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 139/275] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:16.325121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:16.367384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2174-ce13-41bf-a2ec-1bb6fad51168 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:16.390577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:16.406684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649e96-66c8-4c49-aa3e-8ff89ce22c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:16.407547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649e96-66c8-4c49-aa3e-8ff89ce22c1d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.408035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649e96-66c8-4c49-aa3e-8ff89ce22c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.408516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649e96-66c8-4c49-aa3e-8ff89ce22c1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.409809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d649e96-66c8-4c49-aa3e-8ff89ce22c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:16.411593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d649e96-66c8-4c49-aa3e-8ff89ce22c1d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:16.413588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 137/276] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:16.419566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55dbbd-37c3-4196-9da0-f067de7052ad None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.420173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55dbbd-37c3-4196-9da0-f067de7052ad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.420626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55dbbd-37c3-4196-9da0-f067de7052ad None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.422019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 138/277] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:16.423029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55dbbd-37c3-4196-9da0-f067de7052ad None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:16.440674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce252c59-0bc0-4d0c-8df0-aed80d6c5e14 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:16.474797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d8fa7-1dd8-4b08-865d-58eed4970724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:16.475425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d8fa7-1dd8-4b08-865d-58eed4970724 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.475701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d8fa7-1dd8-4b08-865d-58eed4970724 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.475968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d8fa7-1dd8-4b08-865d-58eed4970724 None admin] PATH_INFO: `/v3/users/473bd9cfdec84452a6352131fca25aef` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.487641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:16.489234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d8fa7-1dd8-4b08-865d-58eed4970724 None admin] RBAC: Authorizing `identity:get_user(user_id=473bd9cfdec84452a6352131fca25aef)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:16.490913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d8fa7-1dd8-4b08-865d-58eed4970724 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:16.492862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 140/278] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:16 2022] GET /identity/v3/users/473bd9cfdec84452a6352131fca25aef => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:16.494010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c07df3-c0b6-4a7f-85cd-3671a7ffcc1f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.494290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c07df3-c0b6-4a7f-85cd-3671a7ffcc1f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.494583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c07df3-c0b6-4a7f-85cd-3671a7ffcc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.512257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f4c07df3-c0b6-4a7f-85cd-3671a7ffcc1f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:16.513425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f4c07df3-c0b6-4a7f-85cd-3671a7ffcc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:16.539126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55dbbd-37c3-4196-9da0-f067de7052ad None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:16.575332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:16.576053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.576338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.576611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.577260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:16.578733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:16.586674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 141/279] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:16.586674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c07df3-c0b6-4a7f-85cd-3671a7ffcc1f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:16.613350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 139/280] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:16 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:16.652908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:16.714816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c07df3-c0b6-4a7f-85cd-3671a7ffcc1f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:16.752440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:16.752981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:16.753258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:16.753529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:16.754270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, user.id=473bd9cfdec84452a6352131fca25aef, scope.system=all) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:16.754610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:16.756075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:16.762049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 142/281] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Sep 25 04:22:16 2022] GET /identity/v3/role_assignments?user.id=473bd9cfdec84452a6352131fca25aef&scope.system=all&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:16.864381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:16.982869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac522e89-c393-46dd-afed-ba8fb8522e83 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:16.998890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:17.026141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e2c42-a55d-42a7-a89d-1bfbd47c7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:17.026736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e2c42-a55d-42a7-a89d-1bfbd47c7d53 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.027014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e2c42-a55d-42a7-a89d-1bfbd47c7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.027285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e2c42-a55d-42a7-a89d-1bfbd47c7d53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.038790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e2c42-a55d-42a7-a89d-1bfbd47c7d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1f7e2c42-a55d-42a7-a89d-1bfbd47c7d53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:17.044344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:17.045230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:17.046485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 140/282] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:17.051671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:17.170802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238388b-ad44-4164-a6fe-2cd0938408d6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:17.177461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfd109-47ff-4369-9999-9a6b82a5a25b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.177752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfd109-47ff-4369-9999-9a6b82a5a25b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.178032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfd109-47ff-4369-9999-9a6b82a5a25b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.179668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 141/283] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:17.181678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:17.187229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3cff-bf13-4f42-9117-51d0c013ca78 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.188243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3cff-bf13-4f42-9117-51d0c013ca78 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.188525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3cff-bf13-4f42-9117-51d0c013ca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.210881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b74c3cff-bf13-4f42-9117-51d0c013ca78 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:17.212036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:17.212255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b74c3cff-bf13-4f42-9117-51d0c013ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:17.213077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.213554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.214021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.215036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:17.216311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:17.217950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:17.229017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 143/284] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:17.234942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:17.310650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 142/285] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:17.355201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a4fa9-f5bb-4c5e-a8c6-ed10c26d4284 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:17.397318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:17.398201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.398636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.399074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] PATH_INFO: `/v3/users/e311a535628a423baf4bbc01ce3b5137` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.400365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] RBAC: Authorizing `identity:get_user(user_id=e311a535628a423baf4bbc01ce3b5137)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:17.401998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:17.403899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 144/286] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:17 2022] GET /identity/v3/users/e311a535628a423baf4bbc01ce3b5137 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:17.410228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3cff-bf13-4f42-9117-51d0c013ca78 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:17.555168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3cff-bf13-4f42-9117-51d0c013ca78 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:17.557515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:17.590984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:17.591539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.591814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.592086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.593218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:17.594707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:17.596439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 143/287] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:17 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:17.602084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:17.625035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:17.680214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:17.726506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b6da-558f-4ae3-9878-bbc737169fd5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:17.771046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:17.771682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.771960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.772229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.789558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:17.794602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:17.795440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:17.796192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:17.796774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 144/288] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:17.805537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:17.832813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3366b-af51-4862-ab15-93b8be99f489 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:17.869533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:17.902211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:17.902914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:17.903196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:17.903472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/e311a535628a423baf4bbc01ce3b5137/roles/cbfc30970313458f8c2e05941297b5cc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:17.909057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e15a2ad7c24db684dfaf7ae0391696, user_id=e311a535628a423baf4bbc01ce3b5137, role_id=cbfc30970313458f8c2e05941297b5cc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:17.910558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:17.936459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 145/289] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:17 2022] PUT /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/users/e311a535628a423baf4bbc01ce3b5137/roles/cbfc30970313458f8c2e05941297b5cc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:17.974624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee0990-58c4-42c5-b5b8-0ab4dc1c0992 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:18.012741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:18.013369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:18.013648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:18.013923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:18.014632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:18.014940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:18.016387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:18.025613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 145/290] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:18.041522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:18.168225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:18.174026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26517a-2122-4eca-b2cd-03018ca72cc9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:18.218844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:18.219908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:18.220430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:18.220902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] PATH_INFO: `/v3/users/dd8875aa4dec476abafb236b61cb67df` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:18.222501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8875aa4dec476abafb236b61cb67df)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:18.224266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:18.226572 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 146/291] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:18 2022] GET /identity/v3/users/dd8875aa4dec476abafb236b61cb67df => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:18.231958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:18.364038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:18.370617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae456-08ef-4702-8a68-28d6127a0df1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:18.404840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:18.405451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:18.405733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:18.406009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:18.475986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:18.477398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:18.572429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:18.580716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 146/292] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:18.586085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:18.735847 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ab36-1803-4143-adba-341c34bde400 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:18.773682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77263-ffe2-4827-aeb0-bd1e4dbc3ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:18.774675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77263-ffe2-4827-aeb0-bd1e4dbc3ddc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:18.775158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77263-ffe2-4827-aeb0-bd1e4dbc3ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:18.775653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77263-ffe2-4827-aeb0-bd1e4dbc3ddc None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:18.777043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77263-ffe2-4827-aeb0-bd1e4dbc3ddc None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:18.778722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77263-ffe2-4827-aeb0-bd1e4dbc3ddc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:18.780869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 147/293] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:18 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:18.787019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:18.935256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c7a2-e065-4c3c-a5be-20bac7065984 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:18.991696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd99da-0a39-4c80-8c95-63566995ed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:18.992275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd99da-0a39-4c80-8c95-63566995ed65 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:18.992565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd99da-0a39-4c80-8c95-63566995ed65 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:18.992843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd99da-0a39-4c80-8c95-63566995ed65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:18.993591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd99da-0a39-4c80-8c95-63566995ed65 None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=dd8875aa4dec476abafb236b61cb67df) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:18.993901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd99da-0a39-4c80-8c95-63566995ed65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:18.995378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd99da-0a39-4c80-8c95-63566995ed65 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:19.001707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 147/294] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:18 2022] GET /identity/v3/role_assignments?user.id=dd8875aa4dec476abafb236b61cb67df&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:19.433478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abecc50-5102-4c67-8945-a91ca656d281 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:19.433478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abecc50-5102-4c67-8945-a91ca656d281 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:19.433478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abecc50-5102-4c67-8945-a91ca656d281 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:19.434218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 148/295] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:19.439469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9e10-8925-4a5a-af62-fa5d0d469d65 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:19.439766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9e10-8925-4a5a-af62-fa5d0d469d65 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:19.440042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9e10-8925-4a5a-af62-fa5d0d469d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:19.461447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-766c9e10-8925-4a5a-af62-fa5d0d469d65 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:19.462736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-766c9e10-8925-4a5a-af62-fa5d0d469d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:19.536838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:19.557319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 148/296] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:19.681106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17426839-475a-4b7d-9b2f-e48672b1d097 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:19.682175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17426839-475a-4b7d-9b2f-e48672b1d097 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:19.682666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17426839-475a-4b7d-9b2f-e48672b1d097 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:19.684449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 149/297] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:19.689937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf634c-f70a-4306-86b4-1d353c97289e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:19.690259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf634c-f70a-4306-86b4-1d353c97289e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:19.690596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf634c-f70a-4306-86b4-1d353c97289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:19.710185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8fbf634c-f70a-4306-86b4-1d353c97289e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:19.711435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8fbf634c-f70a-4306-86b4-1d353c97289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:19.771960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350229-68e3-480c-9d8c-0875653b7a86 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:19.772250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350229-68e3-480c-9d8c-0875653b7a86 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:19.772534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350229-68e3-480c-9d8c-0875653b7a86 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:19.774157 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 150/298] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:19.779121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5228d-3c01-43b4-b63d-7a8b7c63b7dc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:19.779410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5228d-3c01-43b4-b63d-7a8b7c63b7dc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:19.779688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5228d-3c01-43b4-b63d-7a8b7c63b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:19.792968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 149/299] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:19.801098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a2f5228d-3c01-43b4-b63d-7a8b7c63b7dc None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:19.802786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a2f5228d-3c01-43b4-b63d-7a8b7c63b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:19.837763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:19.848949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf634c-f70a-4306-86b4-1d353c97289e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:19.886467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 151/300] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:19.958426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf634c-f70a-4306-86b4-1d353c97289e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:19.976085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:19.994147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:19.994822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:19.995135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:19.995440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.010113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:20.015319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:20.016173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:20.017480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:20.020015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 150/301] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:20.025518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5228d-3c01-43b4-b63d-7a8b7c63b7dc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.097316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.130018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5228d-3c01-43b4-b63d-7a8b7c63b7dc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.175637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.176254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.176538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.176815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.177491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:20.177797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.179319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.188693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 152/302] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:20.190122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.207765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1c8f0-d1e5-4210-b6a0-b6e124929317 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.218018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:20.242835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.243491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.243811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.244124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.255892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:20.260984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:20.261842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 151/303] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:20.267771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.306007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d964-4137-48b0-8292-7eaaf359fa48 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.307253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:20.346073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.346729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.347005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.347272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.348464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.349824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.351587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 153/304] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:20.356687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.377752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f3a3-4662-4186-80fc-9319d799fc79 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.412305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.412952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.413375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.413708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] PATH_INFO: `/v3/users/473bd9cfdec84452a6352131fca25aef` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.414944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] RBAC: Authorizing `identity:get_user(user_id=473bd9cfdec84452a6352131fca25aef)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.416409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.417998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 152/305] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:20 2022] GET /identity/v3/users/473bd9cfdec84452a6352131fca25aef => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:20.423752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.455734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:20.462498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f68f5-e1e7-4266-9cd3-835e2e3e915e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.495020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.495623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.495904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.496184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.496845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:20.497150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.498548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.506384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 154/306] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:20.507152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.526867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79deb-3aa9-4d99-bbee-bcf3de4594b1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.535414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:20.563180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efecd3-1a53-487e-a458-9a1659f0b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.563805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efecd3-1a53-487e-a458-9a1659f0b416 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.564115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efecd3-1a53-487e-a458-9a1659f0b416 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.564393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efecd3-1a53-487e-a458-9a1659f0b416 None admin] PATH_INFO: `/v3/groups` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.565015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efecd3-1a53-487e-a458-9a1659f0b416 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.566521 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efecd3-1a53-487e-a458-9a1659f0b416 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.581652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 153/307] 10.222.0.52 () {60 vars in 1134 bytes} [Sun Sep 25 04:22:20 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:20.583758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9793-d761-43ec-91a2-eaa81365b0e8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.584048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9793-d761-43ec-91a2-eaa81365b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.584325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9793-d761-43ec-91a2-eaa81365b0e8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.590052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 154/308] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:20.590052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9793-d761-43ec-91a2-eaa81365b0e8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.610158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc85a83-b52a-4307-893b-b175214546ea None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.651291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aff86-fd3c-4b60-88f0-cd589d6ec927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.652081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aff86-fd3c-4b60-88f0-cd589d6ec927 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.652367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aff86-fd3c-4b60-88f0-cd589d6ec927 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.652722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aff86-fd3c-4b60-88f0-cd589d6ec927 None admin] PATH_INFO: `/v3/system/users/473bd9cfdec84452a6352131fca25aef/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.654271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aff86-fd3c-4b60-88f0-cd589d6ec927 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=473bd9cfdec84452a6352131fca25aef, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.655749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aff86-fd3c-4b60-88f0-cd589d6ec927 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.665356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 155/309] 10.222.0.52 () {58 vars in 1334 bytes} [Sun Sep 25 04:22:20 2022] PUT /identity/v3/system/users/473bd9cfdec84452a6352131fca25aef/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:20.666930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d7b5c-8411-4ef0-abb8-f7f105c3d52d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.667358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d7b5c-8411-4ef0-abb8-f7f105c3d52d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.667760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d7b5c-8411-4ef0-abb8-f7f105c3d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.690714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a16d7b5c-8411-4ef0-abb8-f7f105c3d52d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:20.692131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a16d7b5c-8411-4ef0-abb8-f7f105c3d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:20.709629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:20.737104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9793-d761-43ec-91a2-eaa81365b0e8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.783086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.783732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.784011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.784282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] PATH_INFO: `/v3/users/f44c0303c5014562a2c0d2f1a6cb1b78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.788122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 156/310] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:20.806230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] RBAC: Authorizing `identity:get_user(user_id=f44c0303c5014562a2c0d2f1a6cb1b78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.807763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.810072 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 155/311] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:20 2022] GET /identity/v3/users/f44c0303c5014562a2c0d2f1a6cb1b78 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:20.816539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d7b5c-8411-4ef0-abb8-f7f105c3d52d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:20.928322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d7b5c-8411-4ef0-abb8-f7f105c3d52d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:20.962785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:20.963400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:20.963673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:20.963938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:20.964663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] RBAC: Adding query filter params (role.id=cbfc30970313458f8c2e05941297b5cc, user.id=f44c0303c5014562a2c0d2f1a6cb1b78, scope.system=all) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:20.964969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:20.966429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:20.972453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 157/312] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Sep 25 04:22:20 2022] GET /identity/v3/role_assignments?user.id=f44c0303c5014562a2c0d2f1a6cb1b78&scope.system=all&role.id=cbfc30970313458f8c2e05941297b5cc => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:21.077168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:21.105643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:21.190423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6148a-33bd-4b43-9561-ef7267aeceb6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:21.226269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:21.226936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:21.227214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:21.227480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:21.238557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:21.243472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:21.244322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:21.245078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 156/313] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:21.252193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:21.279283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:21.372135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a171004-7030-4ef5-b0b7-afc2a6cb26f5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:21.409776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:21.410725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:21.411213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:21.411667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:21.412510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:21.412998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:21.414573 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:21.424495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 158/314] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:21.434381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:21.521456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:21.537782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e43529-5fb3-4b06-968c-f38ca7243a0e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:21.575002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:21.575652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:21.575898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:21.576171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] PATH_INFO: `/v3/users/e311a535628a423baf4bbc01ce3b5137` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:21.577307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=e311a535628a423baf4bbc01ce3b5137)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:21.578794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:21.580779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 157/315] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:21 2022] GET /identity/v3/users/e311a535628a423baf4bbc01ce3b5137 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:21.586245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:21.671808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:21.699268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34408-c947-41f0-99ec-d4469a7710c6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:21.735943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:21.736884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:21.737391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:21.737868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:21.810311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:21.812227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:21.896271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:21.924924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 159/316] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:21.932332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:22.035262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe34343-dee4-440e-8022-cb4c3f6ad3f9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:22.070024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af3379-fa89-43c5-a9c6-aae20009c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:22.070610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af3379-fa89-43c5-a9c6-aae20009c156 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:22.070889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af3379-fa89-43c5-a9c6-aae20009c156 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:22.071162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af3379-fa89-43c5-a9c6-aae20009c156 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:22.072277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af3379-fa89-43c5-a9c6-aae20009c156 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:22.073723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af3379-fa89-43c5-a9c6-aae20009c156 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:22.075665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 158/317] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:21 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:22.082023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:22.179324 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f28a8-7f19-4bd2-9f4a-07f17e35c09e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:22.215725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf652e-53ad-4aad-9886-99033e96a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:22.216642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf652e-53ad-4aad-9886-99033e96a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:22.217125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf652e-53ad-4aad-9886-99033e96a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:22.217619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf652e-53ad-4aad-9886-99033e96a6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:22.218581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf652e-53ad-4aad-9886-99033e96a6a7 None admin] RBAC: Adding query filter params (role.id=cbfc30970313458f8c2e05941297b5cc, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696, user.id=e311a535628a423baf4bbc01ce3b5137) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:22.219095 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf652e-53ad-4aad-9886-99033e96a6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:22.220819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf652e-53ad-4aad-9886-99033e96a6a7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:22.227433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 160/318] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:22 2022] GET /identity/v3/role_assignments?user.id=e311a535628a423baf4bbc01ce3b5137&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=cbfc30970313458f8c2e05941297b5cc => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:22.862225 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6545ce-d1fe-4730-b265-93639aa53d37 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:22.862769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6545ce-d1fe-4730-b265-93639aa53d37 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:22.862843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6545ce-d1fe-4730-b265-93639aa53d37 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:22.864504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 159/319] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:22.870365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cf751-5870-4c9f-85f9-def1d6cbc247 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:22.870901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cf751-5870-4c9f-85f9-def1d6cbc247 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:22.870901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cf751-5870-4c9f-85f9-def1d6cbc247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:22.891673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b95cf751-5870-4c9f-85f9-def1d6cbc247 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:22.893022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b95cf751-5870-4c9f-85f9-def1d6cbc247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:22.930118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:22.965813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 161/320] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:22.999375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f0ba-eb06-42b5-b973-5c686adc4d80 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:22.999661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f0ba-eb06-42b5-b973-5c686adc4d80 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:22.999937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f0ba-eb06-42b5-b973-5c686adc4d80 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.001534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 160/321] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:23.007168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aba98-0086-4582-a4ac-ce1c8a8197ba None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.007460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aba98-0086-4582-a4ac-ce1c8a8197ba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.007737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aba98-0086-4582-a4ac-ce1c8a8197ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.026380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f65aba98-0086-4582-a4ac-ce1c8a8197ba None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:23.027598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f65aba98-0086-4582-a4ac-ce1c8a8197ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:23.098540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 162/322] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:23.150524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0bfe-c483-40bb-94c7-98297b5e63d6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.150802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0bfe-c483-40bb-94c7-98297b5e63d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.151073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0bfe-c483-40bb-94c7-98297b5e63d6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.152529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 161/323] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:23.157341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b789585-77c4-49ac-90bf-b3a5d3e1ffb6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.158178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b789585-77c4-49ac-90bf-b3a5d3e1ffb6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.158480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b789585-77c4-49ac-90bf-b3a5d3e1ffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.176597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9b789585-77c4-49ac-90bf-b3a5d3e1ffb6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:23.177771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9b789585-77c4-49ac-90bf-b3a5d3e1ffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:23.235083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0bfe-c483-40bb-94c7-98297b5e63d6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.241982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 163/324] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:23.258555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:23.341016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0bfe-c483-40bb-94c7-98297b5e63d6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:23.371437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b789585-77c4-49ac-90bf-b3a5d3e1ffb6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.378157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:23.378834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.379113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.379387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.380507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:23.381945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:23.383548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 162/325] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:23.388823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.408924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:23.481958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:23.488760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b789585-77c4-49ac-90bf-b3a5d3e1ffb6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:23.495401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a6f1d-1245-4843-bafb-273ad3df692c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:23.525250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb78a0-954b-4265-8485-57346365832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:23.525879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb78a0-954b-4265-8485-57346365832b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.526153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb78a0-954b-4265-8485-57346365832b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.526451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb78a0-954b-4265-8485-57346365832b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.528580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:23.529185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.529460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.529731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] PATH_INFO: `/v3/groups` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.530400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:23.534173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:23.536692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb78a0-954b-4265-8485-57346365832b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-7adb78a0-954b-4265-8485-57346365832b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:23.541536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:23.542717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 164/326] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:23.544420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb78a0-954b-4265-8485-57346365832b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.558409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 163/327] 10.222.0.52 () {60 vars in 1134 bytes} [Sun Sep 25 04:22:23 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:23.558409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.651639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:23.662790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4129b-d435-463a-b515-be14f45e4e0d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:23.662971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb78a0-954b-4265-8485-57346365832b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:23.698971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:23.699601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.699879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.700159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.700845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:23.701152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:23.701764 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:23.702442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.702602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:23.702708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.702981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.712191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 164/328] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:23.718039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.718239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:23.723290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:23.724147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:23.724924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:23.729336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 165/329] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:23.730004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.733718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:23.851982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b9a61-b5db-40de-8863-a1e0760025fd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:23.855302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca302e6-d5d5-46b3-9eb9-13f9dfa81231 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:23.895176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:23.895925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.896180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.897112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:23.897764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] PATH_INFO: `/v3/users/473bd9cfdec84452a6352131fca25aef` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.897893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:23.898090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:23.898387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:23.898567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] RBAC: Authorizing `identity:get_user(user_id=473bd9cfdec84452a6352131fca25aef)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:23.899055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:23.899362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:23.900014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:23.900731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:23.901932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 165/330] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/users/473bd9cfdec84452a6352131fca25aef => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:23.908671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.911456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 166/331] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:23.918274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:23.938744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:24.010506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:24.042595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65ef01-96b4-4528-b257-166902d74eae None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:24.065831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f0fd6-19ee-41c7-bdb0-d0bcf5325490 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:24.084757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:24.085415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:24.085698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:24.085971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:24.086737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] RBAC: Adding query filter params (role.id=601168e670dd4cc8b74dc911848ac3e7, user.id=473bd9cfdec84452a6352131fca25aef, scope.system=all) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:24.087045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:24.088492 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:24.102084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 166/332] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/role_assignments?user.id=473bd9cfdec84452a6352131fca25aef&scope.system=all&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:24.111483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d7935-71c6-4920-8ebb-ed9b35f839cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:24.112523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7935-71c6-4920-8ebb-ed9b35f839cf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:24.112997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7935-71c6-4920-8ebb-ed9b35f839cf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:24.113481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7935-71c6-4920-8ebb-ed9b35f839cf None admin] PATH_INFO: `/v3/users/f44c0303c5014562a2c0d2f1a6cb1b78` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:24.115026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d7935-71c6-4920-8ebb-ed9b35f839cf None admin] RBAC: Authorizing `identity:get_user(user_id=f44c0303c5014562a2c0d2f1a6cb1b78)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:24.116859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d7935-71c6-4920-8ebb-ed9b35f839cf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:24.118856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 167/333] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:23 2022] GET /identity/v3/users/f44c0303c5014562a2c0d2f1a6cb1b78 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:24.124989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:24.263601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59118ed8-6c0c-4a6c-ac95-389314d9ce69 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:24.308656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766056eb-f69e-4b31-8b13-283757452e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:24.309777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766056eb-f69e-4b31-8b13-283757452e28 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:24.310579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766056eb-f69e-4b31-8b13-283757452e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:24.311055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766056eb-f69e-4b31-8b13-283757452e28 None admin] PATH_INFO: `/v3/system/users/f44c0303c5014562a2c0d2f1a6cb1b78/roles/cbfc30970313458f8c2e05941297b5cc` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:24.312947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766056eb-f69e-4b31-8b13-283757452e28 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f44c0303c5014562a2c0d2f1a6cb1b78, role_id=cbfc30970313458f8c2e05941297b5cc)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:24.314689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766056eb-f69e-4b31-8b13-283757452e28 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:24.318755 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:24.327373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 167/334] 10.222.0.52 () {58 vars in 1334 bytes} [Sun Sep 25 04:22:24 2022] PUT /identity/v3/system/users/f44c0303c5014562a2c0d2f1a6cb1b78/roles/cbfc30970313458f8c2e05941297b5cc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:26.347249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036acc-ebca-495f-a84c-cb807361011f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:26.347776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036acc-ebca-495f-a84c-cb807361011f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:26.347776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036acc-ebca-495f-a84c-cb807361011f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:26.349304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 168/335] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:26.355162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23577a8e-bd48-42da-b8c2-8ccb065991dd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:26.356022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23577a8e-bd48-42da-b8c2-8ccb065991dd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:26.356522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23577a8e-bd48-42da-b8c2-8ccb065991dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:26.383400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-23577a8e-bd48-42da-b8c2-8ccb065991dd None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:26.384986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-23577a8e-bd48-42da-b8c2-8ccb065991dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:26.471811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 168/336] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:26.800107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbce2c-f438-4a14-9c1e-00abda003efd None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:26.800515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbce2c-f438-4a14-9c1e-00abda003efd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:26.800690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbce2c-f438-4a14-9c1e-00abda003efd None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:26.802036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 169/337] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:26.808118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df139f2-a8e3-4855-b547-e178894f1ee6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:26.808762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df139f2-a8e3-4855-b547-e178894f1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:26.809234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df139f2-a8e3-4855-b547-e178894f1ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:26.839539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2df139f2-a8e3-4855-b547-e178894f1ee6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:26.841126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2df139f2-a8e3-4855-b547-e178894f1ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:26.857451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbce2c-f438-4a14-9c1e-00abda003efd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:26.957297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 169/338] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:26.960134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b14e0-a6ea-4d07-8f54-1aff8e2e3e4f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:26.960665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b14e0-a6ea-4d07-8f54-1aff8e2e3e4f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:26.961156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b14e0-a6ea-4d07-8f54-1aff8e2e3e4f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:26.962675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 170/339] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:26.967669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653834-9581-42bf-a731-732e7bc848b8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:26.968211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653834-9581-42bf-a731-732e7bc848b8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:26.968703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653834-9581-42bf-a731-732e7bc848b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:26.988495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:27.002483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-18653834-9581-42bf-a731-732e7bc848b8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:27.004087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-18653834-9581-42bf-a731-732e7bc848b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:27.014595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbce2c-f438-4a14-9c1e-00abda003efd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:27.060335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f1a42-19f5-4960-a713-3ae3cfe3dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:27.060974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f1a42-19f5-4960-a713-3ae3cfe3dc84 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.061304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f1a42-19f5-4960-a713-3ae3cfe3dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.061579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f1a42-19f5-4960-a713-3ae3cfe3dc84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.074575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f1a42-19f5-4960-a713-3ae3cfe3dc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3f6f1a42-19f5-4960-a713-3ae3cfe3dc84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:27.079512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:27.080392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:27.081191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 170/340] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:27.082327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504804b-538c-4e39-bc06-0af1777e1f3f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.082327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504804b-538c-4e39-bc06-0af1777e1f3f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.082500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504804b-538c-4e39-bc06-0af1777e1f3f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.084394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 171/341] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:27.086628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504804b-538c-4e39-bc06-0af1777e1f3f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:27.141592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:27.154974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 171/342] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:27.156234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb95c5-d0f8-46cc-8e6c-4982274da694 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.156516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb95c5-d0f8-46cc-8e6c-4982274da694 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.156788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb95c5-d0f8-46cc-8e6c-4982274da694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.197760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-08eb95c5-d0f8-46cc-8e6c-4982274da694 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:27.198997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08eb95c5-d0f8-46cc-8e6c-4982274da694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:27.283402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504804b-538c-4e39-bc06-0af1777e1f3f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:27.332527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 172/343] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:27.333664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb95c5-d0f8-46cc-8e6c-4982274da694 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:27.337159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:27.337765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.338043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.338315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.341687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:27.341687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:27.342875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:27.355278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 172/344] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:27.358003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:27.362647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:27.491009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb95c5-d0f8-46cc-8e6c-4982274da694 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:27.493206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef571427-b986-4059-98af-ead75038a7ea None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:27.542363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:27.547584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:27.548391 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.548670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.548979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.571159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:27.571596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:27.571838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.572121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.572389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:27.576577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:27.577435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:27.578650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 173/345] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:27.585300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:27.708057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:27.709544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:27.712800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:27.716808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2d73-418e-4f30-907f-bb81a5c27ea7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:27.754679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:27.755293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.755573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.755845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.756525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:27.756826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:27.758221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:27.767941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 174/346] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:27.768867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:27.817661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:27.879171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a84d5a-cfe8-49de-be42-22a799da68d8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:27.908777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 173/347] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:22:27.909578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:27.917753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:27.918559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:27.918931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:27.919272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:27.938971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:27.945313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:27.946566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:27.947594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:27.948715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 175/348] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:27.950379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.046596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1b38-a4ba-4a62-abfa-632524baa9b6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.050665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:28.084906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bc03-d365-44f9-b7bf-5586e1c5142d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.086674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:28.094156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.095097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.095479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.095747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.131351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.131997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.132274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.132652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.151968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:28.157023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:28.157987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 04:22:28.158790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:28.160055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 176/349] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:28.160055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.189452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:28.191187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:28.292621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4e6c-b7dc-4c1b-b163-063389e9f31f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.316947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 174/350] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:28.317561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.320020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:28.340934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6457765-aaf7-43ac-9bd1-9da5a3314248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.341950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6457765-aaf7-43ac-9bd1-9da5a3314248 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.342508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6457765-aaf7-43ac-9bd1-9da5a3314248 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.342990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6457765-aaf7-43ac-9bd1-9da5a3314248 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.344363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6457765-aaf7-43ac-9bd1-9da5a3314248 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:28.346638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6457765-aaf7-43ac-9bd1-9da5a3314248 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:28.353178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 177/351] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:28 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:28.354742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aab44-c69d-4fc5-a1b3-1ec4ce64caca None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.355469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aab44-c69d-4fc5-a1b3-1ec4ce64caca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.355893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aab44-c69d-4fc5-a1b3-1ec4ce64caca None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.357335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 178/352] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:28.358269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aab44-c69d-4fc5-a1b3-1ec4ce64caca None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.397690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:28.435243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800889c2-b9cf-4662-80a5-ea4c7b2e4a04 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.488448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.488448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.488448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.488448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.488839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:28.489148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:28.490906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:28.499618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 175/353] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:28.500415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.505031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aab44-c69d-4fc5-a1b3-1ec4ce64caca None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.554741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6613c5-8acc-49c6-b6c4-91d9aba2e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.555187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6613c5-8acc-49c6-b6c4-91d9aba2e44e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.555467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6613c5-8acc-49c6-b6c4-91d9aba2e44e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.555744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6613c5-8acc-49c6-b6c4-91d9aba2e44e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.556416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6613c5-8acc-49c6-b6c4-91d9aba2e44e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:28.556785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6613c5-8acc-49c6-b6c4-91d9aba2e44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:28.558108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6613c5-8acc-49c6-b6c4-91d9aba2e44e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:28.572495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 179/354] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:28.573733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b558-9ba1-4bd2-ac7a-d9f0e35e8930 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.574087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b558-9ba1-4bd2-ac7a-d9f0e35e8930 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.574870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b558-9ba1-4bd2-ac7a-d9f0e35e8930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.578099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:28.596420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-faf3b558-9ba1-4bd2-ac7a-d9f0e35e8930 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:28.597614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-faf3b558-9ba1-4bd2-ac7a-d9f0e35e8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:28.624711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198af7a-8cb5-4731-bb50-42d719ffed56 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.677121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.677710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.677953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.678230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.679402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:28.680865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:28.685835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 176/355] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:28 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:28.685835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.706403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 180/356] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:28.707299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3b558-9ba1-4bd2-ac7a-d9f0e35e8930 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.739894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:28.831931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd381617-3d9c-4bd3-b758-fefab476b5e8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.839193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3b558-9ba1-4bd2-ac7a-d9f0e35e8930 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:28.874900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:28.880827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.881791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.882074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.882371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.884651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa7580-7fcc-433d-a68f-583f0275d809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:28.885271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7580-7fcc-433d-a68f-583f0275d809 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:28.885553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7580-7fcc-433d-a68f-583f0275d809 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:28.885822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7580-7fcc-433d-a68f-583f0275d809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:28.889072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:28.890721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:28.893301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 177/357] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:28 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:28.894825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:28.974616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa7580-7fcc-433d-a68f-583f0275d809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:28.976307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa7580-7fcc-433d-a68f-583f0275d809 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.003461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:29.029063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b4fe-b878-498f-880b-07ef11968c41 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.067243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.067982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.068365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.068668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] PATH_INFO: `/v3/users/f44c0303c5014562a2c0d2f1a6cb1b78` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.071061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=f44c0303c5014562a2c0d2f1a6cb1b78)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:29.072536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.075079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 178/358] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:22:28 2022] GET /identity/v3/users/f44c0303c5014562a2c0d2f1a6cb1b78 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:29.076477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.107157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 181/359] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:29.108708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9297d-2cbf-42af-85d0-6ee4050eac44 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.109184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9297d-2cbf-42af-85d0-6ee4050eac44 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.109459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9297d-2cbf-42af-85d0-6ee4050eac44 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.111035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 182/360] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:29.111858 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9297d-2cbf-42af-85d0-6ee4050eac44 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.149497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:29.198180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851a95c-dbff-4ff8-963c-605c3d43b9c4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.235064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9297d-2cbf-42af-85d0-6ee4050eac44 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.236809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.237670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.237953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.238231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.239427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:29.240871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.242484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 179/361] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:29.243256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.264523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:29.282197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.283529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.283827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.284079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.284808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=66eaf3e7600546a0894142140cc8f276) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:29.285106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:29.286577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.294385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 183/362] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:29.294385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.393126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef3a9-5752-4840-9c2a-e16d8318c9be None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.434127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:29.441479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.442086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b62d6-6987-42e0-a8e2-3313bb7bd04d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.442167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.442475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.442726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.458822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:29.465637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:29.466639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:29.467410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 180/363] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:29.468045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.482266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf5176-6085-47ae-8916-1eb188bc3564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.483347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5176-6085-47ae-8916-1eb188bc3564 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.483839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5176-6085-47ae-8916-1eb188bc3564 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.484355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5176-6085-47ae-8916-1eb188bc3564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.485401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5176-6085-47ae-8916-1eb188bc3564 None admin] RBAC: Adding query filter params (role.id=cbfc30970313458f8c2e05941297b5cc, user.id=f44c0303c5014562a2c0d2f1a6cb1b78, scope.system=all) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:29.485919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5176-6085-47ae-8916-1eb188bc3564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:29.487590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5176-6085-47ae-8916-1eb188bc3564 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.501179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 184/364] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/role_assignments?user.id=f44c0303c5014562a2c0d2f1a6cb1b78&scope.system=all&role.id=cbfc30970313458f8c2e05941297b5cc => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:29.502314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca6e0-775c-437f-8400-0fa40dc43ae3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.502631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca6e0-775c-437f-8400-0fa40dc43ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.502902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca6e0-775c-437f-8400-0fa40dc43ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.529462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c3eca6e0-775c-437f-8400-0fa40dc43ae3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:29.530886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3eca6e0-775c-437f-8400-0fa40dc43ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:29.588871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:29.603302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83840b3-8916-4ccf-962c-67d7082f2c0e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.619247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 185/365] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:29.620421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca6e0-775c-437f-8400-0fa40dc43ae3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.651527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.652187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.652469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.652744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.653934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:29.655640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.657419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 181/366] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:29.658421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.737742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:29.785426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca6e0-775c-437f-8400-0fa40dc43ae3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.791502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc229d-5014-458b-a8f6-18e30431f235 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:29.834843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.835462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.835752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.836008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.836750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:29.837048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:29.838529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.843189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:29.843811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:29.844089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:29.844361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:29.845569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:29.845875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:29.847291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:29.852303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 186/367] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:29.853156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.862508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 182/368] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:29.868426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:29.919657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.019513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239fe70-f614-44ff-803e-c36e7200622d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.021921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca7287-a7ac-4990-a2dc-6a7673d70597 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.050513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.066986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.067753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.068288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.068648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.071484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.072771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.074292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.074816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.076598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:30.078325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:30.081604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 187/369] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:30.083351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.159398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:30.163338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:30.222037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166727bc-df22-42df-84f4-2bd6a69e3b8d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.232114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.273962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.274622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.274906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.275180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.300866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:30.308584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:30.309564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:30.310703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:30.314571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 188/370] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:30.315567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.315975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 183/371] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:22:30.321656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.354406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.452928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0421c95-197b-429a-8b82-3cb610045991 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.460163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4853-70f0-4540-a63d-ef287ff63e7a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.491891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.492547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.492788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.493079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.493808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=66eaf3e7600546a0894142140cc8f276) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:30.494120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:30.495622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:30.501218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.502097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.502611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.503106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.503993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:30.504523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:30.506156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:30.507502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 189/372] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:30.507502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.518584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 184/373] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:30.528183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.558771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.625014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ef8d-c2aa-4ca4-bde6-9501d8f30d6e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.629386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.649955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6052c82-b929-4260-b9ca-5edb71038a81 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.668173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.668836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.669291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.669580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.670864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:30.672496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:30.678491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 190/374] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:30.680179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.692117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.693237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.693731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.694220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.773050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:30.775023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:30.798177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63722c-accb-463c-8d33-6e8ecb05b36b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:30.816490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.838063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:30.838955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:30.839343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:30.839732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:30.842783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:30.845228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:30.852057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 191/375] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:30.853594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.878192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:30.899805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 185/376] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:22:30.905758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:30.979986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaf92d-8700-43a7-b9c5-de4580a681ad None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:31.026740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:31.027584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:31.027968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:31.028346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:31.029470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:31.029887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:31.032997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:31.046676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 192/377] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:31.074629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abba4fa-b474-492b-9b8b-3001c395c2b9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:31.122376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:31.123362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:31.123854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:31.124282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] PATH_INFO: `/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:31.125683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] RBAC: Authorizing `identity:get_project(project_id=38c69cf0e5d8493ba6bb16d3c4dd8b10)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:31.127463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:31.129727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 186/378] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:30 2022] GET /identity/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:31.135549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:31.186740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:31.273594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95988b2e-2410-4ec9-ae4c-a920a5c8665c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:31.309725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf444b-f194-45e8-8235-dd290777842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:31.310667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf444b-f194-45e8-8235-dd290777842f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:31.310955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf444b-f194-45e8-8235-dd290777842f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:31.311234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf444b-f194-45e8-8235-dd290777842f None admin] PATH_INFO: `/v3/groups/62a2848260f84a4d89cca5724eed859d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:31.317938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf444b-f194-45e8-8235-dd290777842f None admin] RBAC: Authorizing `identity:get_group(group_id=62a2848260f84a4d89cca5724eed859d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:31.319515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf444b-f194-45e8-8235-dd290777842f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:31.321222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 193/379] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:31 2022] GET /identity/v3/groups/62a2848260f84a4d89cca5724eed859d => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:31.327501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:31.390998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:31.443823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed536c-1641-4747-93a6-69219b316c8c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:31.480588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5482cd-c7ff-4699-80bb-b4b77d033a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:31.481231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5482cd-c7ff-4699-80bb-b4b77d033a85 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:31.481473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5482cd-c7ff-4699-80bb-b4b77d033a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:31.481828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5482cd-c7ff-4699-80bb-b4b77d033a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:31.482631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5482cd-c7ff-4699-80bb-b4b77d033a85 None admin] RBAC: Adding query filter params (group.id=62a2848260f84a4d89cca5724eed859d, role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=38c69cf0e5d8493ba6bb16d3c4dd8b10) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:31.482946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5482cd-c7ff-4699-80bb-b4b77d033a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:31.484399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5482cd-c7ff-4699-80bb-b4b77d033a85 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:31.498525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 187/380] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:31 2022] GET /identity/v3/role_assignments?group.id=62a2848260f84a4d89cca5724eed859d&scope.project.id=38c69cf0e5d8493ba6bb16d3c4dd8b10&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:32.119791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c747df-7583-4012-be16-49021e09fef1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:32.120339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c747df-7583-4012-be16-49021e09fef1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:32.120339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c747df-7583-4012-be16-49021e09fef1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:32.121722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 194/381] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:32.136287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0001-ee2e-4ce4-b4e5-e73d3808104d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:32.136632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0001-ee2e-4ce4-b4e5-e73d3808104d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:32.136852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0001-ee2e-4ce4-b4e5-e73d3808104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:32.160503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7d1e0001-ee2e-4ce4-b4e5-e73d3808104d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:32.161731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7d1e0001-ee2e-4ce4-b4e5-e73d3808104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:32.244954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 188/382] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:32.562668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c747df-7583-4012-be16-49021e09fef1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:32.665680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab090-77ff-464e-a764-91dd07978a34 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:32.666187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab090-77ff-464e-a764-91dd07978a34 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:32.666296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab090-77ff-464e-a764-91dd07978a34 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:32.667615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 189/383] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:32.675126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb006d-7320-49d6-88ff-39d90e158a95 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:32.675414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb006d-7320-49d6-88ff-39d90e158a95 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:32.675691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb006d-7320-49d6-88ff-39d90e158a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:32.707351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-87cb006d-7320-49d6-88ff-39d90e158a95 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:32.709933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-87cb006d-7320-49d6-88ff-39d90e158a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:32.714710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:32.724603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c747df-7583-4012-be16-49021e09fef1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:32.787784 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:32.788808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:32.789268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:32.789710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:32.795306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:32.809579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:32.815805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:32.816643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:32.817410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 195/384] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:32.834157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:32.843455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 190/385] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:33.003036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0286-4f29-4263-a5e6-7faf6c60d8c1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:33.056402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:33.057017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.057298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.057567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.058237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:33.058575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:33.060219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:33.073959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 196/386] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:33.079550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb006d-7320-49d6-88ff-39d90e158a95 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:33.224123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb006d-7320-49d6-88ff-39d90e158a95 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:33.248690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:33.273705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:33.274662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.275145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.275643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.277014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:33.278690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:33.283024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 191/387] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:33 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:33.286210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:33.300016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:33.353720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:33.414898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998517c-e3eb-4723-bb8c-5a89aec053c7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:33.454892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:33.456221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.456708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.457200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.458612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:33.460557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:33.462419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 192/388] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:33 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:33.468705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:33.532460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d5f90-780b-444b-8e97-939e37d7ecd2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:33.583293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2035cb8-1d18-428e-8edd-4bf3084ad3f7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:33.602240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:33.627569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:33.628853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.629374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.629849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276/groups/ec7c181a2c954d0682a868654c6d7b83/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.632050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=66eaf3e7600546a0894142140cc8f276, group_id=ec7c181a2c954d0682a868654c6d7b83, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:33.633708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:33.655261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144fadc-67c4-4b04-a0e2-5dad135c35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:33.656310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144fadc-67c4-4b04-a0e2-5dad135c35c3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.657915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144fadc-67c4-4b04-a0e2-5dad135c35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.658203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144fadc-67c4-4b04-a0e2-5dad135c35c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.661921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 193/389] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Sep 25 04:22:33 2022] PUT /identity/v3/projects/66eaf3e7600546a0894142140cc8f276/groups/ec7c181a2c954d0682a868654c6d7b83/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:33.673490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144fadc-67c4-4b04-a0e2-5dad135c35c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5144fadc-67c4-4b04-a0e2-5dad135c35c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:33.680241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:33.681091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:33.681896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 197/390] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:33.688845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:33.724591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043af8-b788-4ba2-b6ca-f4784d868566 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.725236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043af8-b788-4ba2-b6ca-f4784d868566 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.725825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043af8-b788-4ba2-b6ca-f4784d868566 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.727666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 198/391] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:33.732840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f749e-f8f6-4d74-8ade-5b41f1d6e23c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.733357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f749e-f8f6-4d74-8ade-5b41f1d6e23c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.733855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f749e-f8f6-4d74-8ade-5b41f1d6e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.753351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b87f749e-f8f6-4d74-8ade-5b41f1d6e23c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:33.754955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b87f749e-f8f6-4d74-8ade-5b41f1d6e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:33.851547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9997e-6ea2-414d-a118-63054af752d0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:33.890463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 199/392] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:33.919227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582a4d5-361a-4ac6-b0f6-e25fc6b547ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:33.919849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a4d5-361a-4ac6-b0f6-e25fc6b547ae None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.920131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a4d5-361a-4ac6-b0f6-e25fc6b547ae None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.920404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a4d5-361a-4ac6-b0f6-e25fc6b547ae None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.921072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582a4d5-361a-4ac6-b0f6-e25fc6b547ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:33.921375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582a4d5-361a-4ac6-b0f6-e25fc6b547ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:33.922884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582a4d5-361a-4ac6-b0f6-e25fc6b547ae None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:33.932075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 194/393] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:33.937572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f749e-f8f6-4d74-8ade-5b41f1d6e23c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:33.946920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d9fc5-1e9d-409c-8fe3-3d3ab4b8e839 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.947193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d9fc5-1e9d-409c-8fe3-3d3ab4b8e839 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.947498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d9fc5-1e9d-409c-8fe3-3d3ab4b8e839 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.949055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 195/394] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:33.952110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:33.955331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90dd01-a699-43df-8294-4e307fa2a143 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:33.955681 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90dd01-a699-43df-8294-4e307fa2a143 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:33.955946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90dd01-a699-43df-8294-4e307fa2a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:33.975761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ee90dd01-a699-43df-8294-4e307fa2a143 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:33.977217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ee90dd01-a699-43df-8294-4e307fa2a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:34.011294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:34.063981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f749e-f8f6-4d74-8ade-5b41f1d6e23c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.073046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 196/395] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:34.074221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07bb41-341b-44d5-b776-2d6abf2d1f8b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.074656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07bb41-341b-44d5-b776-2d6abf2d1f8b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.074934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07bb41-341b-44d5-b776-2d6abf2d1f8b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.076545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 197/396] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:34.082332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7b69-1fd8-4f81-bf5d-7b98cc2e2150 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.082640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7b69-1fd8-4f81-bf5d-7b98cc2e2150 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.082915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7b69-1fd8-4f81-bf5d-7b98cc2e2150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.102241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9cac7b69-1fd8-4f81-bf5d-7b98cc2e2150 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:34.103485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9cac7b69-1fd8-4f81-bf5d-7b98cc2e2150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:34.128147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:34.128835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.129120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.129395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.131597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:34.133958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:34.138594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 200/397] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:33 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:34.144419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.213823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 198/398] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:22:34.214734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7b69-1fd8-4f81-bf5d-7b98cc2e2150 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.301785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:34.347783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ba08-5b97-48ab-8e48-a97be0de4c7e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.405289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:34.413145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7b69-1fd8-4f81-bf5d-7b98cc2e2150 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.416666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:34.417531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.417999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.418494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.419826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:34.421866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:34.429414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 201/399] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:34 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:34.429414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.458491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:34.459135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.459417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.459691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.473108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:34.479052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:34.479958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:34.480732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 199/400] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:34.481385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.551405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea99a5-1128-4038-b83b-5a70c9bff952 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.587134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:34.587770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.588051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.588325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.596304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd906e-8bd3-4531-8cb3-511408861fb6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.599215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:34.604037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:34.604925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:34.605693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 202/401] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:34.607419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.609295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:34.640757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:34.641443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.642254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.642745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/groups/ec7c181a2c954d0682a868654c6d7b83/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.644675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] RBAC: Authorizing `identity:create_grant(project_id=89e15a2ad7c24db684dfaf7ae0391696, group_id=ec7c181a2c954d0682a868654c6d7b83, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:34.646117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:34.660314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 200/402] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Sep 25 04:22:34 2022] PUT /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/groups/ec7c181a2c954d0682a868654c6d7b83/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:34.661162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.687911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:34.741554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427fa3a-e79d-4b31-a740-db2910b476e3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.785402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:34.786633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.787083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.787360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.788043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:34.788404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:34.788994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392987c3-a4f9-4940-914d-c007823ba38f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.789810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:34.806614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 203/403] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:34.807870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.834014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:34.834701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:34.835040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:34.835453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:34.847667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:34.853078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:34.853983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:34.854779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 201/404] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:34.855417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:34.896335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:34.951849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:34.953636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bf53d-5193-4c86-bc6c-e88faf3f3b4a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:34.980420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8f086-f097-4c86-8be3-de3f6d888837 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.010623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.011520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.011806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.012337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.013422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:35.013882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.015527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.019538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.019830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.020110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.020429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.022128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.023633 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.025318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 202/406] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:34 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:35.025544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 204/406] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:35.027207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.030679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.146907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f467c-e180-4259-ad02-0a2163a01856 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.157778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bab90-8ada-49b6-b996-c84b543b1c83 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.174905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:35.185747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.186413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.186697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.187069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.189115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.191453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.197899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 205/407] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:35 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:35.198828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.201174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.202032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.202259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.203414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.204161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:35.204473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.205860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.216559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 203/408] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:35.217476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.221570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:35.333277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664c4f-3f70-432b-915e-e229f4bb2b5b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.336647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8219c-7945-4058-9804-740b0943f612 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.368821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.369462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.369746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.370024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.371454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.373313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.373759 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.374464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.374750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.375025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.375345 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 206/409] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:35 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:35.376264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.381188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.382651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.384593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 204/410] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:35 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:35.385500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.447149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:35.470332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:35.491335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b891-9a39-4012-b2cf-31a7717d1178 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.506223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1d8c4-25cf-4add-8f46-f487a658329f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.526926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.527650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.528003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.528352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] PATH_INFO: `/v3/groups/62a2848260f84a4d89cca5724eed859d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.529651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] RBAC: Authorizing `identity:get_group(group_id=62a2848260f84a4d89cca5724eed859d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.531513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.537961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 207/411] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:35 2022] GET /identity/v3/groups/62a2848260f84a4d89cca5724eed859d => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:35.538891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.544395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.545362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.545640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.545915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276/groups/ec7c181a2c954d0682a868654c6d7b83/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.548744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] RBAC: Authorizing `identity:create_grant(project_id=66eaf3e7600546a0894142140cc8f276, group_id=ec7c181a2c954d0682a868654c6d7b83, role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.550329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.568792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 205/412] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Sep 25 04:22:35 2022] PUT /identity/v3/projects/66eaf3e7600546a0894142140cc8f276/groups/ec7c181a2c954d0682a868654c6d7b83/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:35.571114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.720856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cfdc6-bb02-418d-9cab-6c4da0d75600 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.755069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:35.759605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.760360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.760639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.761888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] PATH_INFO: `/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.763201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] RBAC: Authorizing `identity:get_project(project_id=38c69cf0e5d8493ba6bb16d3c4dd8b10)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.764699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.771372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 206/413] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:35 2022] GET /identity/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:35.773209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:35.805238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58ce0c-f3f2-42e7-ae9b-18c3cefb62c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.845136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:35.855209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255324-ff12-43a5-b8d8-c6bba6797fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.856666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255324-ff12-43a5-b8d8-c6bba6797fb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.856950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255324-ff12-43a5-b8d8-c6bba6797fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.857228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255324-ff12-43a5-b8d8-c6bba6797fb5 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/groups/ec7c181a2c954d0682a868654c6d7b83/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.860501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255324-ff12-43a5-b8d8-c6bba6797fb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e15a2ad7c24db684dfaf7ae0391696, group_id=ec7c181a2c954d0682a868654c6d7b83, role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.862420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255324-ff12-43a5-b8d8-c6bba6797fb5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.883076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 208/414] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Sep 25 04:22:35 2022] PUT /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696/groups/ec7c181a2c954d0682a868654c6d7b83/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:35.898939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcfc00-4787-4e04-a35a-b70d70e0379a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:35.940735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbad6bf-ae99-4994-a8af-8ea120b03107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:35.941433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbad6bf-ae99-4994-a8af-8ea120b03107 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:35.941777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbad6bf-ae99-4994-a8af-8ea120b03107 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:35.942060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbad6bf-ae99-4994-a8af-8ea120b03107 None admin] PATH_INFO: `/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10/groups/62a2848260f84a4d89cca5724eed859d/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:35.944164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbad6bf-ae99-4994-a8af-8ea120b03107 None admin] RBAC: Authorizing `identity:create_grant(project_id=38c69cf0e5d8493ba6bb16d3c4dd8b10, group_id=62a2848260f84a4d89cca5724eed859d, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:35.945660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbad6bf-ae99-4994-a8af-8ea120b03107 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:35.968746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 207/415] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Sep 25 04:22:35 2022] PUT /identity/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10/groups/62a2848260f84a4d89cca5724eed859d/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:22:36.164017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b763-c924-4aa8-a024-f04d1c385548 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:36.164410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b763-c924-4aa8-a024-f04d1c385548 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:36.164576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b763-c924-4aa8-a024-f04d1c385548 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:36.166261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 209/416] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:36.172185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735f05-88ee-4378-9cf6-71450c52ff31 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:36.172462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735f05-88ee-4378-9cf6-71450c52ff31 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:36.172861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735f05-88ee-4378-9cf6-71450c52ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:36.195881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-94735f05-88ee-4378-9cf6-71450c52ff31 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:36.197166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-94735f05-88ee-4378-9cf6-71450c52ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:36.282446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 208/417] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:36.283116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:36.581339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b763-c924-4aa8-a024-f04d1c385548 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:36.720509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b763-c924-4aa8-a024-f04d1c385548 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:36.754363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:36.755312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:36.755792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:36.756282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:36.767419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:36.772490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:36.773328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:36.774095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:36.776601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 210/418] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:36.783041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735f05-88ee-4378-9cf6-71450c52ff31 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:36.913210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735f05-88ee-4378-9cf6-71450c52ff31 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:36.951178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6138-d8e1-40c3-b3c2-2a3a33875bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:36.951792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6138-d8e1-40c3-b3c2-2a3a33875bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:36.952067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6138-d8e1-40c3-b3c2-2a3a33875bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:36.952339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6138-d8e1-40c3-b3c2-2a3a33875bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:36.953007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e6138-d8e1-40c3-b3c2-2a3a33875bb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:36.953309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e6138-d8e1-40c3-b3c2-2a3a33875bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:36.955314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e6138-d8e1-40c3-b3c2-2a3a33875bb0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:36.964122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 209/419] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:36.969939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:37.032643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:37.105179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20446e3-c685-4acb-a8fb-382d6119c18f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:37.152345 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:37.152953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:37.153231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:37.153501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:37.245044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:37.246510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:37.326783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:37.356285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff31a-ad4d-4713-993a-e7d77a5d1059 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:37.356597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff31a-ad4d-4713-993a-e7d77a5d1059 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:37.356842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff31a-ad4d-4713-993a-e7d77a5d1059 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:37.358301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 210/420] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:37.363061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b98de-be99-49de-8431-1faf8c579f87 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:37.363340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b98de-be99-49de-8431-1faf8c579f87 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:37.363616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b98de-be99-49de-8431-1faf8c579f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:37.397703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-df9b98de-be99-49de-8431-1faf8c579f87 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:37.399912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-df9b98de-be99-49de-8431-1faf8c579f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:37.420134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 211/421] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:37.426301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:37.510807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:37.519814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 211/422] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 25 04:22:37.552828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4277d-e20e-4002-b951-286cd15a13af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:37.588528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:37.589258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:37.589438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:37.589712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:37.590870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:37.592309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:37.594286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 212/423] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:37 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:37.600064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b98de-be99-49de-8431-1faf8c579f87 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:37.700556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b98de-be99-49de-8431-1faf8c579f87 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:37.735980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:37.736903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:37.737353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:37.737795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:37.739108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:37.740698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:37.742849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 212/424] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:37 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:37.751502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:37.774631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:37.859978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d071-a179-48c1-af00-21218405fb0a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:37.896849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:37.897698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:37.898170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:37.898700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:37.899619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=66eaf3e7600546a0894142140cc8f276) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:37.900098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:37.901834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:37.908509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 213/425] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:37 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:37.975732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:38.056227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:38.129598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc9d85-3090-4a47-9d38-112b8dd3fa0e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:38.175942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c6f13-a2cc-40d5-9a01-55df1754a2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:38.176585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6f13-a2cc-40d5-9a01-55df1754a2ce None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.176860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6f13-a2cc-40d5-9a01-55df1754a2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.177133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6f13-a2cc-40d5-9a01-55df1754a2ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.191772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c6f13-a2cc-40d5-9a01-55df1754a2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1e8c6f13-a2cc-40d5-9a01-55df1754a2ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:38.196678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:38.197547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:38.198323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 213/426] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:38.203525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:38.224517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0326-4ed1-4891-880c-03c7bac83a03 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.224789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0326-4ed1-4891-880c-03c7bac83a03 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.225789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0326-4ed1-4891-880c-03c7bac83a03 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.227588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 214/427] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:38.234093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3a42-8fd1-44db-99fe-ea4a0713264d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.234802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3a42-8fd1-44db-99fe-ea4a0713264d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.237267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3a42-8fd1-44db-99fe-ea4a0713264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.261065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-493e3a42-8fd1-44db-99fe-ea4a0713264d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:38.262517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-493e3a42-8fd1-44db-99fe-ea4a0713264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:38.318811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:38.338752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d97a36-fcf8-4190-a071-17a700b9f6d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:38.345860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 215/428] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:38.381780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:38.382820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.383800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.384682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:38.385195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:38.386828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:38.395982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 214/429] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:22:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:38.403520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3a42-8fd1-44db-99fe-ea4a0713264d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:38.456085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:38.526780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3a42-8fd1-44db-99fe-ea4a0713264d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:38.564919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13dc10-39ab-490a-884b-7dfba29cb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:38.565892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13dc10-39ab-490a-884b-7dfba29cb34c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.566411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13dc10-39ab-490a-884b-7dfba29cb34c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.566881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13dc10-39ab-490a-884b-7dfba29cb34c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.645079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13dc10-39ab-490a-884b-7dfba29cb34c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:38.646981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13dc10-39ab-490a-884b-7dfba29cb34c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:38.650969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:38.694999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:38.762483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 216/430] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:38.764474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473325-fc0a-4df1-a777-701dd36cf170 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.764766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473325-fc0a-4df1-a777-701dd36cf170 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.765046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473325-fc0a-4df1-a777-701dd36cf170 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.767390 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 217/431] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:38.768382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473325-fc0a-4df1-a777-701dd36cf170 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:38.770413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c94b1-e643-4c5d-a219-c4e1cf4c6800 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:38.812014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482a10-73cf-46cb-88e4-41e063ad639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:38.812683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482a10-73cf-46cb-88e4-41e063ad639d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.812967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482a10-73cf-46cb-88e4-41e063ad639d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.813760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482a10-73cf-46cb-88e4-41e063ad639d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.826387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42482a10-73cf-46cb-88e4-41e063ad639d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-42482a10-73cf-46cb-88e4-41e063ad639d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:38.832412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:38.833325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:38.834339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 215/432] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:38.835368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22511d43-db7e-475f-9bd5-1a35ab2debab None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.835368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22511d43-db7e-475f-9bd5-1a35ab2debab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.835368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22511d43-db7e-475f-9bd5-1a35ab2debab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.842630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:38.853720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-22511d43-db7e-475f-9bd5-1a35ab2debab None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:38.854958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-22511d43-db7e-475f-9bd5-1a35ab2debab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:38.878600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473325-fc0a-4df1-a777-701dd36cf170 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:38.913746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c743ed-3bab-4e0d-a181-3ac7339c3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:38.914315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c743ed-3bab-4e0d-a181-3ac7339c3906 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.914620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c743ed-3bab-4e0d-a181-3ac7339c3906 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.914896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c743ed-3bab-4e0d-a181-3ac7339c3906 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.916026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c743ed-3bab-4e0d-a181-3ac7339c3906 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:38.917465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c743ed-3bab-4e0d-a181-3ac7339c3906 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:38.919114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 218/433] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:38 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:38.920221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784919d-7cb7-4809-be18-c57b3e63ba62 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:38.920524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784919d-7cb7-4809-be18-c57b3e63ba62 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:38.920779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784919d-7cb7-4809-be18-c57b3e63ba62 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:38.921964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 219/434] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:38.923359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784919d-7cb7-4809-be18-c57b3e63ba62 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:38.929533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 216/435] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:38.930398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22511d43-db7e-475f-9bd5-1a35ab2debab None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:38.939513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.037828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784919d-7cb7-4809-be18-c57b3e63ba62 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.038463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22511d43-db7e-475f-9bd5-1a35ab2debab None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.073383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.073986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.074267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.074399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be26a1-f917-404d-9a8b-4616615ab62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.074573 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.074995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be26a1-f917-404d-9a8b-4616615ab62e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.075233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:39.075326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be26a1-f917-404d-9a8b-4616615ab62e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.075535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.075628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be26a1-f917-404d-9a8b-4616615ab62e None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.076708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be26a1-f917-404d-9a8b-4616615ab62e None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.076902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.078193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be26a1-f917-404d-9a8b-4616615ab62e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.079875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 217/436] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:38 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:39.081108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c2fb-7ec9-4f7b-a001-307f37672030 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.081547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c2fb-7ec9-4f7b-a001-307f37672030 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.081963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c2fb-7ec9-4f7b-a001-307f37672030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.088230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 220/437] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:39.089031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.093246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.107681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f91c2fb-7ec9-4f7b-a001-307f37672030 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:39.108899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f91c2fb-7ec9-4f7b-a001-307f37672030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:39.165226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.179122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 218/438] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:39.180144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c2fb-7ec9-4f7b-a001-307f37672030 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.209990 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836a5cb-662e-478f-bf97-d30bbc5799c6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.246408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.247021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.247302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.247584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.248306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=601168e670dd4cc8b74dc911848ac3e7, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:39.248622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.250287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.257097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 221/439] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=601168e670dd4cc8b74dc911848ac3e7 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:39.258211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.317271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c2fb-7ec9-4f7b-a001-307f37672030 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.363573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.372302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.373459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.374191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.374678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.378042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8a827-09d8-411c-8806-585d9204866f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.419178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.420190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.420652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.421118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.424191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.435474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:39.440540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:39.441468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:39.442273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 222/440] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:39.447318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.475053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.476532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.557136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2362-0c2e-4b5b-a1a1-99419aec57b1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.577125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 219/441] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:39.577983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.592255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.592868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.593169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.593452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.594111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:39.594970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.596355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.604562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 223/442] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:39.605343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.611279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.663501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.678583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83119677-d674-4712-b759-951e9d8b6fb4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.707425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428f945-c65b-46a8-9949-a98e09e259e0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.711961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.712603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.712879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.713147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.723527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:39.728280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:39.729137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:39.729910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 220/443] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:39.730575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.744828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.745464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.745744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.746023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] PATH_INFO: `/v3/projects/66eaf3e7600546a0894142140cc8f276` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.747187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] RBAC: Authorizing `identity:get_project(project_id=66eaf3e7600546a0894142140cc8f276)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.748641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.750569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 224/444] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/projects/66eaf3e7600546a0894142140cc8f276 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:39.751841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.819458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.829123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86beed5c-7f4e-4079-9b14-6a81c8231d34 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.847956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595f37-b2ca-4f80-9ed3-d35dd0eba58b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:39.861831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.862450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.862728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.862997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.870048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:39.882206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:39.882943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:39.883224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:39.883496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:39.884158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:39.884460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.885832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.894380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 225/445] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:39.895226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:39.930889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:39.932280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:39.992644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66e425-bbd2-47a4-8386-a90c233144d1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.019146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:40.028789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 221/446] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:40.029626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.029872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.030518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.030803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.031081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.032954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.035258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.036865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 226/447] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:39 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:40.037639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.093304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:40.127401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277669-e4d3-4918-a6ac-5f13d95817bc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.139362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093a97-5b55-4609-88cd-78b084dc77e2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.160185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.160786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.161069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.161340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.171972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.173144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.173425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.173705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] PATH_INFO: `/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.174868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] RBAC: Authorizing `identity:get_project(project_id=38c69cf0e5d8493ba6bb16d3c4dd8b10)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.176315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.177935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 227/448] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/projects/38c69cf0e5d8493ba6bb16d3c4dd8b10 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:40.178724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.220553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:40.230140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.231655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.280420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4d95-15b5-453e-8c30-3a81d1d8312d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.303263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:40.315669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.316269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.316545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.316816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.317530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=66eaf3e7600546a0894142140cc8f276) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:40.317832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.319292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.324823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 228/449] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=66eaf3e7600546a0894142140cc8f276&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:40.325590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.334479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 222/450] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:40.341370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.447074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:40.457801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969b0b3-cbfe-4393-ad9a-79862cd3b180 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.462091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99379-6fc7-4da3-bc56-8c111bf74cfd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.493883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.494471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.494761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.495027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] PATH_INFO: `/v3/projects/89e15a2ad7c24db684dfaf7ae0391696` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.496169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=89e15a2ad7c24db684dfaf7ae0391696)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.497626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.499592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 223/451] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/projects/89e15a2ad7c24db684dfaf7ae0391696 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:40.505436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.505749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.506116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.506506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.506687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] PATH_INFO: `/v3/groups/62a2848260f84a4d89cca5724eed859d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.507810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] RBAC: Authorizing `identity:get_group(group_id=62a2848260f84a4d89cca5724eed859d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.509235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.511106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 229/452] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/groups/62a2848260f84a4d89cca5724eed859d => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:40.516855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.583393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:40.630562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f303da-8324-4753-b2ad-ab0aa81fd6b7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.638067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ce589-a01e-4365-986e-46e2fced4ee5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.673785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.674454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.674739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.675014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] PATH_INFO: `/v3/groups/ec7c181a2c954d0682a868654c6d7b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.677300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7c181a2c954d0682a868654c6d7b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.678700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49a438-7119-495e-93e5-d573edadf9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.678828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.679310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a438-7119-495e-93e5-d573edadf9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.679589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a438-7119-495e-93e5-d573edadf9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.679862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a438-7119-495e-93e5-d573edadf9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.680635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 224/453] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/groups/ec7c181a2c954d0682a868654c6d7b83 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:40.680737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49a438-7119-495e-93e5-d573edadf9d0 None admin] RBAC: Adding query filter params (group.id=62a2848260f84a4d89cca5724eed859d, role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=38c69cf0e5d8493ba6bb16d3c4dd8b10) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:40.680961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49a438-7119-495e-93e5-d573edadf9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.682799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49a438-7119-495e-93e5-d573edadf9d0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.687056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:40.689700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 230/454] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/role_assignments?group.id=62a2848260f84a4d89cca5724eed859d&scope.project.id=38c69cf0e5d8493ba6bb16d3c4dd8b10&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:40.722391 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:40.806087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24834891-2a60-4d7e-943d-6be6f055fc25 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:40.846860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d06700-a55f-407d-b107-732916c9ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:40.847494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06700-a55f-407d-b107-732916c9ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:40.847770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06700-a55f-407d-b107-732916c9ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:40.848042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06700-a55f-407d-b107-732916c9ed60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:40.848793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d06700-a55f-407d-b107-732916c9ed60 None admin] RBAC: Adding query filter params (group.id=ec7c181a2c954d0682a868654c6d7b83, role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=89e15a2ad7c24db684dfaf7ae0391696) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:40.849106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d06700-a55f-407d-b107-732916c9ed60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:40.850620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d06700-a55f-407d-b107-732916c9ed60 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:40.857604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 225/455] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Sep 25 04:22:40 2022] GET /identity/v3/role_assignments?group.id=ec7c181a2c954d0682a868654c6d7b83&scope.project.id=89e15a2ad7c24db684dfaf7ae0391696&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:43.643180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962010-3f6d-41a5-b501-05f21e1cc8bf None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:43.643709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962010-3f6d-41a5-b501-05f21e1cc8bf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:43.643795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962010-3f6d-41a5-b501-05f21e1cc8bf None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:43.645081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 231/456] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:43.650227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7865b-561c-44d1-81ab-6bb69535934e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:43.650636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7865b-561c-44d1-81ab-6bb69535934e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:43.650821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7865b-561c-44d1-81ab-6bb69535934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:43.675379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a2c7865b-561c-44d1-81ab-6bb69535934e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:43.676579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a2c7865b-561c-44d1-81ab-6bb69535934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:43.752475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 226/457] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:44.043616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd2f4-b895-495a-abd0-b6f6a110e420 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.044261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd2f4-b895-495a-abd0-b6f6a110e420 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.044756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd2f4-b895-495a-abd0-b6f6a110e420 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.046780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 232/458] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:44.048567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad6af4-4ce6-4c05-876f-f87f03498a91 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.049049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad6af4-4ce6-4c05-876f-f87f03498a91 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.049510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad6af4-4ce6-4c05-876f-f87f03498a91 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.051417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669e83a-5bbb-49d2-93a3-4bb049dce8b0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.051928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669e83a-5bbb-49d2-93a3-4bb049dce8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.052388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669e83a-5bbb-49d2-93a3-4bb049dce8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.060226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 227/459] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:44.062816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f9f2-d173-443a-8096-15012d58b6df None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.071850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f9f2-d173-443a-8096-15012d58b6df None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.072401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f9f2-d173-443a-8096-15012d58b6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.087382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3669e83a-5bbb-49d2-93a3-4bb049dce8b0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:44.088580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3669e83a-5bbb-49d2-93a3-4bb049dce8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:44.101026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8686f9f2-d173-443a-8096-15012d58b6df None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:44.102613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8686f9f2-d173-443a-8096-15012d58b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:44.121092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:44.162689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 233/460] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:44.170794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669e83a-5bbb-49d2-93a3-4bb049dce8b0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:44.177642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 228/461] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:44.237940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:44.307074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669e83a-5bbb-49d2-93a3-4bb049dce8b0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:44.347422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:44.348342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.348762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.349176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.359778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:44.361952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:44.378377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:44.379301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:44.380118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:44.380118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:44.380118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:44.380118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 234/462] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:44.384348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686f9f2-d173-443a-8096-15012d58b6df None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:44.463768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:44.516427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686f9f2-d173-443a-8096-15012d58b6df None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:44.563979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942abd2-501b-474a-a36b-3d690b88aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:44.565077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942abd2-501b-474a-a36b-3d690b88aa3f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.565507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942abd2-501b-474a-a36b-3d690b88aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.566339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942abd2-501b-474a-a36b-3d690b88aa3f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.567216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942abd2-501b-474a-a36b-3d690b88aa3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:44.567667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942abd2-501b-474a-a36b-3d690b88aa3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:44.569727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942abd2-501b-474a-a36b-3d690b88aa3f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:44.579162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:44.582638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7a6bd-60dd-4c54-a40e-0ea4715c1215 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:44.588341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 229/463] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:44.589930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a96b5-9b1a-46d1-b98a-7861cacead7f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.590383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a96b5-9b1a-46d1-b98a-7861cacead7f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.590803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a96b5-9b1a-46d1-b98a-7861cacead7f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.592813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 230/464] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:44.593948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a96b5-9b1a-46d1-b98a-7861cacead7f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:44.610738 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:44.620120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:44.620754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.621032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.621310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.631900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:44.633341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:44.647797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:44.649374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:44.650537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:44.650537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:44.650537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:44.650537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 235/465] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:44.654420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:44.705990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a96b5-9b1a-46d1-b98a-7861cacead7f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:44.741773 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1265f6-cf2a-45f9-8437-51c46603d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:44.742432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1265f6-cf2a-45f9-8437-51c46603d2ae None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.742719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1265f6-cf2a-45f9-8437-51c46603d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.742993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1265f6-cf2a-45f9-8437-51c46603d2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.754627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1265f6-cf2a-45f9-8437-51c46603d2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:44.756081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1265f6-cf2a-45f9-8437-51c46603d2ae None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:44.757846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c1a7f-3ec2-448d-be6a-d45afed066d2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2f1265f6-cf2a-45f9-8437-51c46603d2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:44.771950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:44.773368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:44.775823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:44.775823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:44.775823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:44.775823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 231/466] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:44.775823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4050a4-ed56-44ee-bbd3-a7d724a07b03 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.775823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4050a4-ed56-44ee-bbd3-a7d724a07b03 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.775823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4050a4-ed56-44ee-bbd3-a7d724a07b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.794228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6d4050a4-ed56-44ee-bbd3-a7d724a07b03 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:44.795305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6d4050a4-ed56-44ee-bbd3-a7d724a07b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:44.799803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:44.800408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:44.800689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:44.800960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:44.801599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:44.803070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:44.830334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 236/467] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:44 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:44.831626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:44.850589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:44.865193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:44.876692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 232/468] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:44.878047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4050a4-ed56-44ee-bbd3-a7d724a07b03 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:44.997067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4050a4-ed56-44ee-bbd3-a7d724a07b03 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.037970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb18f7-ebd0-4778-97b9-c0850cb23af3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.038445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749c87f-80a3-4250-bfd7-f1377a2be16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.039157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749c87f-80a3-4250-bfd7-f1377a2be16f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.039781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749c87f-80a3-4250-bfd7-f1377a2be16f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.040134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749c87f-80a3-4250-bfd7-f1377a2be16f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.041046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749c87f-80a3-4250-bfd7-f1377a2be16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:45.041582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749c87f-80a3-4250-bfd7-f1377a2be16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.043125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749c87f-80a3-4250-bfd7-f1377a2be16f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.060823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 233/469] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:45.062777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2f80-5af9-4885-b70c-415935810d73 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.063592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2f80-5af9-4885-b70c-415935810d73 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.063873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2f80-5af9-4885-b70c-415935810d73 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.065261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 234/470] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:45.070177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2f80-5af9-4885-b70c-415935810d73 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:45.090627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232213-b201-44d5-aaff-b14e4928f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.091018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232213-b201-44d5-aaff-b14e4928f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.091328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232213-b201-44d5-aaff-b14e4928f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.091933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232213-b201-44d5-aaff-b14e4928f1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.092256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232213-b201-44d5-aaff-b14e4928f1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:45.092562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232213-b201-44d5-aaff-b14e4928f1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.093953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232213-b201-44d5-aaff-b14e4928f1e1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.108326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 237/471] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:45.110221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f460-e2da-4133-a838-7397ae56ac49 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.110541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f460-e2da-4133-a838-7397ae56ac49 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.110848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f460-e2da-4133-a838-7397ae56ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.130618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dd18f460-e2da-4133-a838-7397ae56ac49 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:45.131826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dd18f460-e2da-4133-a838-7397ae56ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:45.146215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:45.205564 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:45.210687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2f80-5af9-4885-b70c-415935810d73 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.211671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 238/472] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:45.212495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f460-e2da-4133-a838-7397ae56ac49 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:45.250643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.251606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.252069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.252555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.253495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.255418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.280485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 235/473] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:45 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:45.282006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:45.405503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f460-e2da-4133-a838-7397ae56ac49 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.412445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0bfd4-be4b-409a-be1f-1fbc11d1cf90 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.425606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:45.466101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.467185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.468220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.468830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.485625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.486688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.487084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.487434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.487897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.488664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.488997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.490807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:45.514853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:45.516030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:45.517672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:45.517672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:45.517672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:45.517672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 236/474] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:45.518082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:45.528173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 239/475] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:45 2022] POST /identity/v3/users => generated 248 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:45.529501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:45.608135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:45.642082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c137bb8-8243-4254-a39f-e4e2579aa290 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.643560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c926c-52e1-47f3-a31f-65fc778e4ecd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.683997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.684758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.685644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.685927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.686203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.686441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.686907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.687006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.687474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.688898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:45.689002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.689511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.691153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.697204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.sql.core [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 04:22:45.697204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 25 04:22:45.697204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [parameters: {'id': '8a75c641aa9a4cfdbce78bb8e4ad5b66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 25 04:22:45.697204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 04:22:45.706971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 240/476] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:45.714588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 25 04:22:45.714844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return ref.to_dict() Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 04:22:45.716005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application yield resource Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise self.value Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application session.commit() Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 04:22:45.716902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.flush() Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application compat.raise_( Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 04:22:45.717786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 04:22:45.724955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 04:22:45.726829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [parameters: {'id': '8a75c641aa9a4cfdbce78bb8e4ad5b66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:45.729114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 25 04:22:45.731227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:45.734668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 237/477] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Sep 25 04:22:45 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:45.734668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:45.774758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:45.881179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d7cec-5639-41af-81d5-cba9fdca1ada None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.889935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a6716-de97-459f-ace6-c7f065e8c563 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:45.897467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:45.921894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.923133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.923411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.923676 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.924323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:45.926542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:45.930696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b3e8-0453-471f-bd3b-c8ca3b0156fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:45.931333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b3e8-0453-471f-bd3b-c8ca3b0156fb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:45.931616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b3e8-0453-471f-bd3b-c8ca3b0156fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:45.931891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b3e8-0453-471f-bd3b-c8ca3b0156fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:45.945572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b3e8-0453-471f-bd3b-c8ca3b0156fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7817b3e8-0453-471f-bd3b-c8ca3b0156fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:45.952113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:45.953001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 04:22:45.954298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:45.954948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 241/478] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:45 2022] POST /identity/v3/users => generated 249 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:22:45.955019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 238/479] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:22:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:45.961735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:46.100086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2289-f519-4e23-af36-2d3854491dd0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:46.156094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb43957-e58e-4ff8-804b-35efe7f870be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:46.156806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb43957-e58e-4ff8-804b-35efe7f870be None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:46.157672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb43957-e58e-4ff8-804b-35efe7f870be None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:46.157956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb43957-e58e-4ff8-804b-35efe7f870be None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:46.159069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb43957-e58e-4ff8-804b-35efe7f870be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:46.159630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb43957-e58e-4ff8-804b-35efe7f870be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:46.161515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb43957-e58e-4ff8-804b-35efe7f870be None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:46.172591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 242/480] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:47.588586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd7e3-5729-42c8-ba61-72bde390606b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:47.589064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd7e3-5729-42c8-ba61-72bde390606b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:47.589064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd7e3-5729-42c8-ba61-72bde390606b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:47.590722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 239/481] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:47.595620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e515f52-4471-4533-af21-5ee9ac1b6d20 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:47.595993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e515f52-4471-4533-af21-5ee9ac1b6d20 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:47.596180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e515f52-4471-4533-af21-5ee9ac1b6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:47.619735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4e515f52-4471-4533-af21-5ee9ac1b6d20 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:47.620933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4e515f52-4471-4533-af21-5ee9ac1b6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:47.655650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:47.710507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 243/482] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:48.154323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededd7e3-5729-42c8-ba61-72bde390606b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:48.256798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:48.283908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededd7e3-5729-42c8-ba61-72bde390606b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:48.333835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef3eb4-154e-4673-932c-ca2efcf7d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:48.334516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef3eb4-154e-4673-932c-ca2efcf7d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.334793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef3eb4-154e-4673-932c-ca2efcf7d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.335072 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef3eb4-154e-4673-932c-ca2efcf7d5c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.346560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef3eb4-154e-4673-932c-ca2efcf7d5c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-97ef3eb4-154e-4673-932c-ca2efcf7d5c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:48.355578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:48.356518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:48.357302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 240/483] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:48.363413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e515f52-4471-4533-af21-5ee9ac1b6d20 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:48.391847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54d209-f676-4ade-a62b-e45f880cebc9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.392109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54d209-f676-4ade-a62b-e45f880cebc9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.392432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54d209-f676-4ade-a62b-e45f880cebc9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.393855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 241/484] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:48.399406 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3724fb6-c13c-4b4c-ac62-8578eefe3ab9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.399670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3724fb6-c13c-4b4c-ac62-8578eefe3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.399946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3724fb6-c13c-4b4c-ac62-8578eefe3ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.424074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d3724fb6-c13c-4b4c-ac62-8578eefe3ab9 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:48.425228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d3724fb6-c13c-4b4c-ac62-8578eefe3ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:48.524198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 242/485] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:48.550229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e515f52-4471-4533-af21-5ee9ac1b6d20 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:48.557287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fec2-ae4d-43a9-8bf3-cf861a3f6533 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.557862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fec2-ae4d-43a9-8bf3-cf861a3f6533 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.558425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fec2-ae4d-43a9-8bf3-cf861a3f6533 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.560443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 243/486] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:48.567509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65820-a863-4071-8689-f590da78ae0f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.568012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65820-a863-4071-8689-f590da78ae0f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.568482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65820-a863-4071-8689-f590da78ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.591340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:48.591951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.592228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.592498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.593273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:48.602371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:48.602371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:48.603941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 244/487] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:48.609259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7ab65820-a863-4071-8689-f590da78ae0f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:48.609667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:48.611209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7ab65820-a863-4071-8689-f590da78ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:48.638870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:48.702638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 244/488] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:48.703917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735cc1b-2d4f-443f-ba32-99e09df7b960 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.704201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735cc1b-2d4f-443f-ba32-99e09df7b960 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.704473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735cc1b-2d4f-443f-ba32-99e09df7b960 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.705971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 245/489] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:48.711341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598740-93ed-4619-ba0e-28131905c03b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.712998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598740-93ed-4619-ba0e-28131905c03b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.714122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598740-93ed-4619-ba0e-28131905c03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.734652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93370986-8edf-4f18-ad2a-24b296942c8d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:48.739312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:48.743632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e2598740-93ed-4619-ba0e-28131905c03b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:48.744934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e2598740-93ed-4619-ba0e-28131905c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:48.809117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:48.809862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:48.810492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:48.810843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:48.822514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:48.824069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:48.839873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:48.840846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:48.841650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:48.841650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:48.841650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:48.841650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 245/490] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:48.842243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:48.849908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 246/491] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:48.851001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598740-93ed-4619-ba0e-28131905c03b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:48.965716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:48.988790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598740-93ed-4619-ba0e-28131905c03b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:48.992469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c338e6-ab2e-4278-821f-ea3bb6d6331f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.024111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba88fe-6fb6-4fb7-a294-3ab208541826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.024718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba88fe-6fb6-4fb7-a294-3ab208541826 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.025097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba88fe-6fb6-4fb7-a294-3ab208541826 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.025464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba88fe-6fb6-4fb7-a294-3ab208541826 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.026213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba88fe-6fb6-4fb7-a294-3ab208541826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:49.026551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba88fe-6fb6-4fb7-a294-3ab208541826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.027911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.028023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba88fe-6fb6-4fb7-a294-3ab208541826 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.028544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.028824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.029100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.030507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.040276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:49.045795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 247/492] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:49.045795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c4b4-32b6-4360-b72d-565b186e43aa None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.045795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c4b4-32b6-4360-b72d-565b186e43aa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.045795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c4b4-32b6-4360-b72d-565b186e43aa None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.045795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 248/493] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:49.045795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c4b4-32b6-4360-b72d-565b186e43aa None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:49.049984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:49.050989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:49.051769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:49.052378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 246/494] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:49.053040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.154364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c4b4-32b6-4360-b72d-565b186e43aa None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.157174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7fce3-2c6b-431d-866b-6c3e44b66985 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.186964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731fe12-74d0-43c4-bc09-34ab5e2af55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.187581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731fe12-74d0-43c4-bc09-34ab5e2af55d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.187881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731fe12-74d0-43c4-bc09-34ab5e2af55d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.188672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731fe12-74d0-43c4-bc09-34ab5e2af55d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.190660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.191280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.191557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.191831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.194531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.198458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731fe12-74d0-43c4-bc09-34ab5e2af55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:49.200629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.202248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8731fe12-74d0-43c4-bc09-34ab5e2af55d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:49.203657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:49.204529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:49.205632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 249/495] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:49.206507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0a34-415a-4058-a5a9-e03a2a0ddcc4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.206507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0a34-415a-4058-a5a9-e03a2a0ddcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.206507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0a34-415a-4058-a5a9-e03a2a0ddcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:49.217736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:49.218876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 247/496] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:49.219974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.225145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-46de0a34-415a-4058-a5a9-e03a2a0ddcc4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:49.226329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-46de0a34-415a-4058-a5a9-e03a2a0ddcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:49.279282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.296051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 250/497] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:49.296875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0a34-415a-4058-a5a9-e03a2a0ddcc4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.326791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608434-86ba-4e12-9471-e37fe26e4bbc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.361017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.361622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.361903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.362173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.362850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:49.363158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.364531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.372941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 248/498] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:49.373706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.405419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0a34-415a-4058-a5a9-e03a2a0ddcc4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.433197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.443471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.444380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.444829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.445299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.455457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.457093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:49.472364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:49.473308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:49.474115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:49.474115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:49.474115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:49.475267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaf15a-7801-4181-9e40-1a7abac15611 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.475958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 251/499] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:49.476869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.512418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.513141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.513425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.513709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.514404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:49.514715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.516704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.523825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.529652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 249/500] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:49.529652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.592201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5877248-40f0-433c-a739-cc5e762c8767 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.625923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.626555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.626834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.627104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.627827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:49.628132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.629550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf55606-3511-40c4-9a00-4e2d3d1dca70 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.629935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.649513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.663558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.664188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.664467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.664695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 252/501] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:49.664795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.665520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.679773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.681220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:49.695414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:49.696322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:49.697627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:49.697627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:49.697627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:49.697627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 250/502] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:49.697627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.764130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.770931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54ae5-2f8a-4bd6-baca-94f39760ba50 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.796567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691f433-5ef6-4fff-965f-86f9c2922916 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.803869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.804477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.804756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.805029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.805667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:49.805971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.807401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.818562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 253/503] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:49.819368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.834977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.835752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.836035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.836308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.847473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:49.848911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:49.862555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:49.863613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:49.864921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:49.864921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:49.864921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:49.864921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 251/504] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:49.864921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.889739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:49.925758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d6bde-9aca-4b04-8a5c-9a5324e8a56f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.960901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:49.961536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:49.961817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:49.962092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:49.966888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588a17b-f8b7-45f8-bf39-91d9a656b34b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:49.973256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:49.979864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:49.980926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 254/505] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:49.981707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:49.999254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.003164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.003775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.004054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.004325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.071582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.072972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.078289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6bc5-2cd8-400c-8c3d-1c22320d5f84 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.095984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.111346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.111954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.112231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.112504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.113149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:50.114197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.114864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.127287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 255/506] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:50.127855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.172561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 252/507] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:50.173396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.207900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.231679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227e30-7da2-4aa6-9306-72c4bdd0543d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.271744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.272381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.272661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.272939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.273586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.275057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.275683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1913-a66e-4a1e-b5a7-16b46888ed9c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.295786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 256/508] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:22:50 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:22:50.296601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.311611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.325743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.326284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.326595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.326912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.327520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:50.327830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.329287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.341824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 253/509] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:50.342738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.415317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd790f81-7d36-4672-afdc-f583e4d000c2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.448899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.450837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81777c1-fc53-49c4-addd-ecaebfc59ca5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.456317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.456944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.457222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.457495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.458177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:50.458726 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.459908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.469415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 257/510] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:50.470264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.496444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.497387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.497673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.498212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] PATH_INFO: `/v3/users/glance` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.506238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.507796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:50.523544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:50.524466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:50.525352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 254/511] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:50.525891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.577228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.600617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95fed-3621-4c76-a9b0-3cc8e74b96fb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.638577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccecda3-0a1c-4798-bf16-eba0524d74af None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.640242 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.641335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.641613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.641887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.652347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.653806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:50.667827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:50.668717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:50.674760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:50.674760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:50.674760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:50.674760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 258/512] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:50.674760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.680208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.680920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.681273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.681616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.689732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.691323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:50.702712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:50.704276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:50.705194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 255/513] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:50.705736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.728292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.787208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f72ab-4cf7-467a-b312-0e139601576b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.812347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fea24-479c-4113-922d-40015ecbeec8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:50.817401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.823620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.824249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.824530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.824802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.836351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.837750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.852336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:50.852553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:50.853375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:50.854187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:50.854187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:50.854187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:50.854341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:50.854341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:50.854341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:50.854341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:50.854595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:50.855993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:50.859062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 259/514] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:50.860559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.894778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 256/515] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:50.895647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:50.971270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:50.975936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed9536-8a03-4fd5-b696-fe344c3c1c8d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.004397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb920-ddf5-4be3-a9a7-b1813cd6f71a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.013223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.013835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.014116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.014419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.015066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:51.015370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.016819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.033594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 260/516] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:51.033594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.045206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.045812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.046092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.046372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.047376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:51.047684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.049127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.071687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 257/517] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Sep 25 04:22:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:51.072817 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.098331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.142147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dda1b7-7876-4846-9e8a-47e65616c884 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.178946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.179650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.179995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.180340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.181053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:51.181416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.182558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dc69-7389-4950-bdca-c0fde8feeb23 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.183190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.196739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 261/518] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:51.201857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.223522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.224153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.224849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.224849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.228049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.303793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.305714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.316729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9532-cd02-4125-b02c-eda7376367f6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.326686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.353763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.354333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.354648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.354911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.362573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.363973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:51.376004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:51.376807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:51.377613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 262/519] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:51.378870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.423175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 258/520] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:51.423175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.458292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.483762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc107-123f-4e90-bfaf-5d9f48d2287c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.522840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.523448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.523728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.524001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.533820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d6393-d1d6-4620-9907-a2e321232227 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.557332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.572391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.573017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.573299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.573580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.580656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.582111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:51.593621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:51.595085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:51.595953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 259/521] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:51.596489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.606379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.607896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.690703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.696096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110cb4-5cb3-4464-a43c-a60fb4fb0add None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.716073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 263/522] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:51.717140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.733943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.734584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.734931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.735271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.735962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:51.736272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.737695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.757404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 260/523] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:51.758212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.803030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.824904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace7a4f-5ff1-474d-b3ac-27706972ff9b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.860452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.861001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.861285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.861565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.864507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c45ba-9843-4ac2-9139-f62c13458c5b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:51.871483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.872893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:51.888404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:51.889292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:51.895752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:51.895752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:51.895752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:51.895752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 264/524] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:51.895752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:51.908313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:51.908932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:51.909200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:51.909471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:51.910204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:51.910539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:51.911970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:51.926908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:51.930822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 261/525] 10.222.0.52 () {56 vars in 1139 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:51.931821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.006652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bc1c6-cbab-4859-9ab8-35e913edf175 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.035660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.040099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88463d-46fc-4530-955c-0aba0021eccd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.042247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.042919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.043203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.043484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.054658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.056111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:52.070666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:52.071599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:52.072410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:52.072410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:52.072410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:52.072410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 265/526] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:52.072625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.082312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.083294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.083758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.084200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.085101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=079636b6d56943928420801c47555aea) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:52.085716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.087255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.102804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 262/527] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:51 2022] GET /identity/v3/role_assignments?user.id=079636b6d56943928420801c47555aea&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:52.103921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.194696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.223111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef022a-460a-474a-b476-1e07fe763a5c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.238941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072a935-91fc-409e-9101-64291b32d493 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.273356 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.274112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.274532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.274930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.275685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:52.277000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.278692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.286851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.288190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.288190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.288190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.294381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 266/528] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:52.296887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.326070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.371443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.373642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.420869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94493a-a8e8-4883-8c99-5daf909b2695 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.456995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.457536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.457827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.458106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.458790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:52.459098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.460580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.477222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 267/529] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:52.478185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.481129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.495007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 263/530] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:22:52.495927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.564934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.595259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099a45-d793-4c23-9867-9aa2e4e7d81a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.608624 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537cd2d-f240-4a49-8f57-a8048fe0024a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.633843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.634512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.634795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.635094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.643313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.644579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89003f93-9c8a-4e4c-9886-6583abff20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.644794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.645202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f93-9c8a-4e4c-9886-6583abff20a8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.645478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f93-9c8a-4e4c-9886-6583abff20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.645743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f93-9c8a-4e4c-9886-6583abff20a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.652549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89003f93-9c8a-4e4c-9886-6583abff20a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.653965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89003f93-9c8a-4e4c-9886-6583abff20a8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:52.656984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:52.657789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:52.658975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 268/531] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:52.659438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-89003f93-9c8a-4e4c-9886-6583abff20a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:52.670775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:52.671607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:52.672995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 264/532] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:52.674185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371685a7-8c72-4e26-95d8-9bf589724925 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.674185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371685a7-8c72-4e26-95d8-9bf589724925 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.674535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371685a7-8c72-4e26-95d8-9bf589724925 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.678475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 265/533] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:52.678475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371685a7-8c72-4e26-95d8-9bf589724925 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.732220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.776637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaef1-8965-4038-b6a8-5479171a7145 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.783968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371685a7-8c72-4e26-95d8-9bf589724925 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.806103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.814857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d45067-ae2b-4cca-9665-a841bb21a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.815515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d45067-ae2b-4cca-9665-a841bb21a01b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.815780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d45067-ae2b-4cca-9665-a841bb21a01b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.816054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d45067-ae2b-4cca-9665-a841bb21a01b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.819753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.820511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.820930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.821342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.822181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:52.822684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.824349 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.826772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d45067-ae2b-4cca-9665-a841bb21a01b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:52.828222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d45067-ae2b-4cca-9665-a841bb21a01b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:52.842151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 266/534] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:52.842151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-41d45067-ae2b-4cca-9665-a841bb21a01b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:52.848357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:52.849260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:52.850086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:52.850086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:52.850086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:52.850086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 269/535] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:52.850991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34113a8-f4b8-4fee-bc0d-c3a92c073b31 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.851497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34113a8-f4b8-4fee-bc0d-c3a92c073b31 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.851774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34113a8-f4b8-4fee-bc0d-c3a92c073b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.870247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e34113a8-f4b8-4fee-bc0d-c3a92c073b31 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:52.871475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e34113a8-f4b8-4fee-bc0d-c3a92c073b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:52.939673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 270/536] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:52.940523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34113a8-f4b8-4fee-bc0d-c3a92c073b31 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:52.956856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6fef-eac8-4e21-96a0-4d6a8afc5a51 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:52.989152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:52.996007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:52.997779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:52.998329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:52.998838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:52.999772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:53.000999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.003627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.017423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 267/537] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:53.018648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.051826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34113a8-f4b8-4fee-bc0d-c3a92c073b31 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.067020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:53.087384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.088122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.088403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.088676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.089707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=78f639af7ae54e06b8baa10e77236c8c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:53.090026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.091779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.106380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 271/538] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:52 2022] GET /identity/v3/role_assignments?user.id=78f639af7ae54e06b8baa10e77236c8c&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:53.106380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.169432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc144108-bb7d-4a56-a6e2-210255b4f432 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.219517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5da1-4872-4f57-bbd7-7602574dd272 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.232163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:53.247884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.248427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.248708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.248982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.249638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:53.250004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.251492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.261089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.261791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.262140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.262532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.263357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=f955275faf8349fc8d42068bd774ad10) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:53.263734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.265440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.272726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 268/539] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:53.273869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 272/540] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/role_assignments?user.id=f955275faf8349fc8d42068bd774ad10&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:53.274248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.279429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.398746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31315-32db-483d-9197-dcc760455d8f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.401305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:53.432572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355c64-f835-4f73-9640-a2a1a325f2fd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.443688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.444772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.445250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.445836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.458576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:53.464325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:53.465237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:53.465996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:53.471927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 269/541] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:53.475581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.485443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.491042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.491650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.492136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.506608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.509237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:53.527961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:53.528840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:53.529663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 273/542] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:53.535465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.568618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:53.624302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb57ec-b968-4567-996c-9e9c1f0e3e19 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.662889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.663893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.664392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.664925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.665912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:53.666524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.668158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.678181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 270/543] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:53.691641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0e604-5c4b-44be-b606-f5714636a31d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.692938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.731944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.732559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.733084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.733084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.733770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:53.734073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.736052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.753502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:53.788699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 274/544] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:53.799838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.829075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b2be7-4274-45d6-b910-55e5a5ec3ad0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:53.864497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:53.865240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:53.865525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:53.865800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:53.877321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:53.878839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:53.895452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:53.896373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:53.897182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:53.897182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:53.897182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:53.901436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 271/545] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:53.903031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:53.990719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:54.007229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be046947-e014-4f25-a663-3e60318f7446 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:54.022662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:54.065321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c600a63-8850-4ad0-ada1-ebff6513ab97 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:54.084147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:54.084776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:54.085053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:54.085319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:54.086050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=d4f75c3e044d4b0dbad6b16ea0599bab) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:54.086653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:54.088110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:54.100816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 275/546] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/role_assignments?user.id=d4f75c3e044d4b0dbad6b16ea0599bab&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:54.172995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:54.173819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:54.174098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:54.174378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:54.179893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:54.179893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:54.179893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:54.213099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 272/547] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:54.218643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:54.433426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d74dc-1abb-473f-9544-477d451ba697 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:54.478152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b42e6-a376-4768-8b60-de2f6f3505ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:54.478843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b42e6-a376-4768-8b60-de2f6f3505ea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:54.479121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b42e6-a376-4768-8b60-de2f6f3505ea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:54.479394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b42e6-a376-4768-8b60-de2f6f3505ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:54.489498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b42e6-a376-4768-8b60-de2f6f3505ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:54.491014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b42e6-a376-4768-8b60-de2f6f3505ea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-129b42e6-a376-4768-8b60-de2f6f3505ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:54.505673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:54.507125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:22:54.508157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:54.511016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 276/548] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:22:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:54.513599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:54.600704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067255a-a811-42c1-bbf1-4dd7a5598f17 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:54.601043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067255a-a811-42c1-bbf1-4dd7a5598f17 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:54.601250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067255a-a811-42c1-bbf1-4dd7a5598f17 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:54.602618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 277/549] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:22:54.609290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc338bdd-e962-430a-b1de-133c0e87248b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:54.609943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc338bdd-e962-430a-b1de-133c0e87248b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:54.610218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc338bdd-e962-430a-b1de-133c0e87248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:54.675641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dc338bdd-e962-430a-b1de-133c0e87248b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:54.676908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dc338bdd-e962-430a-b1de-133c0e87248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:54.702095 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f140c-8e9a-4b42-86cc-01ec31faf80a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:54.717053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:54.752534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:54.753850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:54.754783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:54.755836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:54.759471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:54.761187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:54.764701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:54.771868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:54.819611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 273/550] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Sep 25 04:22:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:54.826686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:54.920000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 278/551] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:55.018409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0753a-11ec-4e32-9cc7-b64c0b47163d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:55.057812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:55.058449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.058734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.059012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.150702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:55.155032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:55.156557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:55.194261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc338bdd-e962-430a-b1de-133c0e87248b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:55.273981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 274/552] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:22:55.279503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:55.387185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:55.394269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e47d5-7bc6-4f22-8a74-9ea67b22f0fd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:55.425483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc338bdd-e962-430a-b1de-133c0e87248b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:55.429545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:55.430276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.430658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.431005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.442393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:55.444091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:55.460941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:55.462162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:55.463231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:55.463231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:55.463231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:55.463231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 275/553] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:55.469823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:55.491680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:55.492424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.492779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.493126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.505512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:55.510777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:55.511698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:55.512796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 279/554] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:22:55.518371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:55.536208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:55.654255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501e8f2-0b95-4938-8370-a9811c66292f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:55.699330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:55.699957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.700244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.700586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.701270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:55.701580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:55.702993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:55.713112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 280/555] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:55.718610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:55.802962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:55.836516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ab0ba-c90d-4008-844a-0b0211b06629 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:55.841690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38f751-3d05-47cc-8822-20b7dec99830 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:55.882048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e4a9-fd51-43b3-8a42-5cbb934bab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:55.883351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e4a9-fd51-43b3-8a42-5cbb934bab53 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.883908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e4a9-fd51-43b3-8a42-5cbb934bab53 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.884196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e4a9-fd51-43b3-8a42-5cbb934bab53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.897385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93e4a9-fd51-43b3-8a42-5cbb934bab53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:55.898970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93e4a9-fd51-43b3-8a42-5cbb934bab53 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:55.916918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d506889-9f57-473b-a816-d376162bef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:55.917533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506889-9f57-473b-a816-d376162bef5d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.917814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506889-9f57-473b-a816-d376162bef5d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cb93e4a9-fd51-43b3-8a42-5cbb934bab53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:55.917998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:55.919369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:55.920961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:55.920961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:55.920961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:55.921124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506889-9f57-473b-a816-d376162bef5d None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.921124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d506889-9f57-473b-a816-d376162bef5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:55.921124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d506889-9f57-473b-a816-d376162bef5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:55.921311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 281/556] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:55.921376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d506889-9f57-473b-a816-d376162bef5d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:55.921441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dff26-a072-429f-999b-3e1774dbb23a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.921441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dff26-a072-429f-999b-3e1774dbb23a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.921441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dff26-a072-429f-999b-3e1774dbb23a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.925653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 282/557] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:55.926777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dff26-a072-429f-999b-3e1774dbb23a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:55.943478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 276/558] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:55.944750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576307-e414-4835-bd5c-468ff2c118f7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:55.945037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576307-e414-4835-bd5c-468ff2c118f7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:55.945310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576307-e414-4835-bd5c-468ff2c118f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:55.957900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:55.964257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3d576307-e414-4835-bd5c-468ff2c118f7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:55.965478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3d576307-e414-4835-bd5c-468ff2c118f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:56.040874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 277/559] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:56.041776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576307-e414-4835-bd5c-468ff2c118f7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.059049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dff26-a072-429f-999b-3e1774dbb23a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.084914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:56.100959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e530673-cad2-4a34-ac6c-d2feb05e2877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.101762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e530673-cad2-4a34-ac6c-d2feb05e2877 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.102053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e530673-cad2-4a34-ac6c-d2feb05e2877 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.102337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e530673-cad2-4a34-ac6c-d2feb05e2877 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.103126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e530673-cad2-4a34-ac6c-d2feb05e2877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:56.103475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e530673-cad2-4a34-ac6c-d2feb05e2877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:56.104971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e530673-cad2-4a34-ac6c-d2feb05e2877 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:56.118706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 283/560] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:22:56.119933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3c81-7a48-4abc-b427-8ba8f6d2ebc0 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.120219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3c81-7a48-4abc-b427-8ba8f6d2ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.120548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3c81-7a48-4abc-b427-8ba8f6d2ebc0 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.126023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 284/561] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:56.127471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b782-b0b7-479b-9fc6-8dbbc3ecbf4b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.127761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b782-b0b7-479b-9fc6-8dbbc3ecbf4b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.128231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b782-b0b7-479b-9fc6-8dbbc3ecbf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.147109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7ba3b782-b0b7-479b-9fc6-8dbbc3ecbf4b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:56.148371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7ba3b782-b0b7-479b-9fc6-8dbbc3ecbf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:56.162489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576307-e414-4835-bd5c-468ff2c118f7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.199688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.200331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.200611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.200885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.204513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:56.209249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:56.210902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:56.223419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:56.224714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 278/562] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:56.226976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.232116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 285/563] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:56.236290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3b782-b0b7-479b-9fc6-8dbbc3ecbf4b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.339741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e62c-e690-4f26-9f91-0e0eae0f2701 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.378540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.379227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.379613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.379894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.388649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:56.389890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:56.402272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3b782-b0b7-479b-9fc6-8dbbc3ecbf4b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:56.404171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:56.405101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 279/564] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:56.406017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.418562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:56.451532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.452336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.452953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.453881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.455620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:56.456037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:56.457586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:56.480566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:56.480734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 286/565] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:56.481393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.527663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325399d1-0866-4363-970b-2a7c46b20459 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.565103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.565976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.566456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.566918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.579111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:56.585969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:56.586954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:56.587776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 280/566] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:56.588449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.611594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb048-fba5-426c-99c0-4ef6bc39a190 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.647106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.647958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.648239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.648514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.649271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:56.649581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:56.651076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:56.668592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 287/567] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:56.671278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.700351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c3c0-c8ce-4455-8c4d-34c5b09aa1e3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.707768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:56.721780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:56.744310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.745325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.745614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.746163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.746951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=12819d6a0c19462d82b285502d0e27b0) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:56.747483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:56.749610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:56.766701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 281/568] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/role_assignments?user.id=12819d6a0c19462d82b285502d0e27b0&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:56.766701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.797802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215d50-0276-4bd7-a968-d39823df4e5d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.837498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.838197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.838453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.838726 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.850941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:56.856012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:56.856979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:56.857781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 288/569] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:56.859293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.899662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567b71-0e32-4da0-800f-12fee338aaba None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:56.935988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e522eec-952a-4672-a57d-1e60780115d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:56.936604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e522eec-952a-4672-a57d-1e60780115d4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.936884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e522eec-952a-4672-a57d-1e60780115d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.937158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e522eec-952a-4672-a57d-1e60780115d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.938376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e522eec-952a-4672-a57d-1e60780115d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:56.938689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e522eec-952a-4672-a57d-1e60780115d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:56.940052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e522eec-952a-4672-a57d-1e60780115d4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:56.948460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 282/570] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:56.949486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49d0c-7ac5-487f-a402-ed1996a361c3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:56.949774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49d0c-7ac5-487f-a402-ed1996a361c3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:56.950050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49d0c-7ac5-487f-a402-ed1996a361c3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:56.951406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 283/571] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:56.951975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49d0c-7ac5-487f-a402-ed1996a361c3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:56.980998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:56.993745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a234582-d36b-4e3a-b846-e9a5726f7d3a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.004148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:57.032065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.032698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.032983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.033255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.044020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.045537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:57.060623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:57.061570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:57.063684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:57.063684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:57.063684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:57.063684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 289/572] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:57.063684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.070965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49d0c-7ac5-487f-a402-ed1996a361c3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.105129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086761d6-8eda-4eb1-83b0-660f1b646b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.105741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086761d6-8eda-4eb1-83b0-660f1b646b0f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.106023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086761d6-8eda-4eb1-83b0-660f1b646b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.106302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086761d6-8eda-4eb1-83b0-660f1b646b0f None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.106999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086761d6-8eda-4eb1-83b0-660f1b646b0f None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:57.107304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086761d6-8eda-4eb1-83b0-660f1b646b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.108682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086761d6-8eda-4eb1-83b0-660f1b646b0f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.117242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 284/573] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:57.119696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c45f-5e01-4019-8764-2ee92c850c71 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.119980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c45f-5e01-4019-8764-2ee92c850c71 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.120250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c45f-5e01-4019-8764-2ee92c850c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.141041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2408c45f-5e01-4019-8764-2ee92c850c71 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:57.142337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2408c45f-5e01-4019-8764-2ee92c850c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:57.173534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489d5f-a5b4-4de0-80eb-7481ff223ddd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.209658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 285/574] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:57.211790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408c45f-5e01-4019-8764-2ee92c850c71 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.214615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.215250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.215533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.215802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.225660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:57.227674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.229372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:57.247001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:57.247972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:57.248837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:57.248837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:57.248837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:57.248837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 290/575] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:57.248837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.255830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:57.353319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408c45f-5e01-4019-8764-2ee92c850c71 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.370724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d534-b876-48f6-83a7-7b04d834412c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.390422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.391939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.392424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.392900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.393784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:57.394305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.395927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.408362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 286/576] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:57.409730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.417400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.418044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.418333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.418636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.430311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.431797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:57.447508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:57.448431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:57.449297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:57.449297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:57.449297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:57.453941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 291/577] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:57.454694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.507867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:57.522693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:57.530864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021bbd7-04b1-49da-ba9f-167a2769d4c1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.567530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.568138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.568415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.568686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.568851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16839ca5-c503-4317-a1f1-a0aab378ef19 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.569326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:57.569627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.571031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.588164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 287/578] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:57.588164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.609572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.610209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.610544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.610824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.617698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.619257 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:57.633373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:57.634249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:57.635184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 292/579] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:57.636551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.695974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86798-16b8-4b19-b5e8-0027a23590c4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.730210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.730842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.731129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.731406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.732053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:57.732358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.733742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.745171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 288/580] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:57.750904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.755692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac97ec-faf8-4dcd-a3f2-e68320f924aa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.758766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:57.766652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:57.796306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.797132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.797418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.797712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.810319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:22:57.816674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:57.817566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:57.818458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 293/581] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:57.819760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.858654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7193b18-209e-4946-a275-72a15b9fe264 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.893514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92367752-0f49-472a-8172-0b965607a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.894227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92367752-0f49-472a-8172-0b965607a544 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.894608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92367752-0f49-472a-8172-0b965607a544 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.894806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92367752-0f49-472a-8172-0b965607a544 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.902671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92367752-0f49-472a-8172-0b965607a544 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.904323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92367752-0f49-472a-8172-0b965607a544 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-92367752-0f49-472a-8172-0b965607a544 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:57.916254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:57.917184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 289/582] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:57.918143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92367752-0f49-472a-8172-0b965607a544 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:57.924888 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff21e0e-56b6-40d1-ac5e-c0fc14d37c61 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:57.960575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:57.961117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:57.961405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:57.961681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:57.962402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:57.962722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:57.964174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:57.976202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 294/583] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:57.977161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.005209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.010852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.035328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92367752-0f49-472a-8172-0b965607a544 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.071869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.072526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.072769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.073036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.081162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.082646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:58.094992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:58.095954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 290/584] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:58.101760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.108752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3e87-126a-4b50-8ae5-a0e5c227284b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.145622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.146336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.146703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.147042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.147881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:58.148248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.149803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.160462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 295/585] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:58.161314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.212278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940449d0-788e-4bad-b4d0-625ee26a501b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.247741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.248348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.248637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.248916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.249645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:58.249952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.251460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.253032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.253171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.271369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67441b-cfe2-4093-a42d-628525c3a52b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.275359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 291/586] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:58.276035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.310448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.311243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.312290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.312290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/079636b6d56943928420801c47555aea/roles/ffccef46ca484651b96df0b7a6254ff4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.328525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=079636b6d56943928420801c47555aea, role_id=ffccef46ca484651b96df0b7a6254ff4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.330101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.350370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 296/587] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:58 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/079636b6d56943928420801c47555aea/roles/ffccef46ca484651b96df0b7a6254ff4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:58.350370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.396712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290e189-ca47-4171-b604-5ee39a331212 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.449302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.450244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.450557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.451269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.452077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:58.452391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.454455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.468612 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2cf8e-6429-420c-bce2-09d106edf70f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.480373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 292/588] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:58.482041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.507510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.508312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.508648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.509013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.512589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.524276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.525978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:58.550124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:58.551114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:58.552002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:58.552002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:58.552002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:58.554002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 297/589] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:58.555033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.560574 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.629020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d07c-33cd-432b-adde-b9a9710544d0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.670545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad392e-bd35-43ee-be14-4a860a966e96 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.671633 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.672528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.673090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.673539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.684476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.686505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:58.702124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:58.703750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:58.704601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:58.704601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:58.704601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:58.706743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 293/590] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:58.707693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.719108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.719407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.719687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.719955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.731783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.733243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:58.749541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:58.751121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:58.752009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:58.752009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:58.752009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:58.752009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 298/591] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:58.752222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.796849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.819942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851bc2-e898-433b-a2df-1ee60b92b6e2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.822124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:58.865213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.866092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.866543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.866982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.867774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:58.868227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.868793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a318e1-6f39-4eb3-b868-6099c64443a1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:58.869912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.887320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 294/592] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:58.888426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.906999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:58.907870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:58.908014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:58.908253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:58.908957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:58.909299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:58.910654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:58.928469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 299/593] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:58.929741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:58.997357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063155fa-26eb-472a-9f19-fb8fc47a58fe None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.034363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.034969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.035387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.035757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.036292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:59.036620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.037990 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.040715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.044443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046239c-e776-4ba9-a356-746237ca2407 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.049951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 295/594] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:59.050931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.080224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.081588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b08ab4-433d-4e5e-88eb-bb9e7327f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.082305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b08ab4-433d-4e5e-88eb-bb9e7327f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.082826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b08ab4-433d-4e5e-88eb-bb9e7327f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.083224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b08ab4-433d-4e5e-88eb-bb9e7327f5f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.090586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b08ab4-433d-4e5e-88eb-bb9e7327f5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.092119 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b08ab4-433d-4e5e-88eb-bb9e7327f5f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-34b08ab4-433d-4e5e-88eb-bb9e7327f5f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:22:59.104324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:59.105448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 300/595] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:59.106879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a23140-aaf6-4999-a16c-680a56ecd1a4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.107524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a23140-aaf6-4999-a16c-680a56ecd1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.107524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a23140-aaf6-4999-a16c-680a56ecd1a4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.110386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 301/596] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:22:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:22:59.110386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a23140-aaf6-4999-a16c-680a56ecd1a4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.167678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107d5f-4af5-40fc-b149-fa9886835d18 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.203076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.203882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.204231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.204575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.211468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.212989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.219837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a23140-aaf6-4999-a16c-680a56ecd1a4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:59.225111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:59.225973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:22:59.226921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 296/597] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:59.227388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.265043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd18ad-95b1-4b61-bb01-e89edc77a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.265770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd18ad-95b1-4b61-bb01-e89edc77a265 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.266052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd18ad-95b1-4b61-bb01-e89edc77a265 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.266323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd18ad-95b1-4b61-bb01-e89edc77a265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.273363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd18ad-95b1-4b61-bb01-e89edc77a265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.274843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd18ad-95b1-4b61-bb01-e89edc77a265 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fabd18ad-95b1-4b61-bb01-e89edc77a265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:22:59.286798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:59.287890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:59.288745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 302/598] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:59.289200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2e3d9-dbed-47a7-b152-bdcd3a0ce0a5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.289342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2e3d9-dbed-47a7-b152-bdcd3a0ce0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.289614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2e3d9-dbed-47a7-b152-bdcd3a0ce0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.308006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-16f2e3d9-dbed-47a7-b152-bdcd3a0ce0a5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:22:59.309262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-16f2e3d9-dbed-47a7-b152-bdcd3a0ce0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:22:59.325071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.327507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.348207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612078dd-2d0b-42d5-a0c6-99cb901b312b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.385110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.390414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 303/599] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:22:59.390546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.390546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.390546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.391321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2e3d9-dbed-47a7-b152-bdcd3a0ce0a5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.391391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:59.391391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.391391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.415065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 297/600] 10.222.0.52 () {56 vars in 1139 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:59.419358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.519715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2e3d9-dbed-47a7-b152-bdcd3a0ce0a5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.544897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e0dea-f48e-4896-a40f-6acfaf4df743 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.564620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.565831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.566290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.567016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.568290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:59.568790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.570916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.590399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.590399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.590399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.590399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.590777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:22:59.590777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.590777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.591408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 304/601] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:59.592737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.605642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.609896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.610269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 298/602] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:22:59.611889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.714489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c70dd-fe15-4431-b132-d01a6cb6e978 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.736137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367cc58-c9d0-4b97-af6e-01cda3f2ad98 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.749611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.750265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.750586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.750856 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.762048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.763525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.771342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.771956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.772234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.772515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/78f639af7ae54e06b8baa10e77236c8c/roles/ffccef46ca484651b96df0b7a6254ff4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:22:59.778398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:22:59.779316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:22:59.780170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:22:59.780170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:22:59.780170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:22:59.784690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 305/603] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:22:59.785249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.788799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=78f639af7ae54e06b8baa10e77236c8c, role_id=ffccef46ca484651b96df0b7a6254ff4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.790260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.803863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 299/604] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:59 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/78f639af7ae54e06b8baa10e77236c8c/roles/ffccef46ca484651b96df0b7a6254ff4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:59.804744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:22:59.867927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.885399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:22:59.919396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30975c-9934-436b-a9bb-ca87379ed5cd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.958171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:22:59.958920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:22:59.959200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:22:59.959472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/f955275faf8349fc8d42068bd774ad10/roles/ffccef46ca484651b96df0b7a6254ff4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:22:59.962581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04c5f-4a0e-49c0-a06d-7840011b0773 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:22:59.976500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=f955275faf8349fc8d42068bd774ad10, role_id=ffccef46ca484651b96df0b7a6254ff4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:22:59.977979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:22:59.997295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 306/605] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:22:59 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/f955275faf8349fc8d42068bd774ad10/roles/ffccef46ca484651b96df0b7a6254ff4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:22:59.998780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.015921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.015921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.015921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.016300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.034025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:00.041071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:00.042081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:00.042960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 300/606] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:00.049506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.143354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc5c2-1f82-4214-9b6e-bd4bc0912cdc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:00.160089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:00.188225 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.189277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.189780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.190285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.191214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:00.191752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:00.193399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:00.207059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 307/607] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:00.211179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074248-b924-4651-ab05-f73c2eb243e1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:00.213828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.225259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:00.264300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.265884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.266167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.268702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.268702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:00.268702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:00.268947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:00.280946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 301/608] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:00.286445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.348232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79149-5e64-419d-aa15-86f39daa366e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:00.421690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.422617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.422998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.423392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.437528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:00.439167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:00.462478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:00.463553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:00.464651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:00.472697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 308/609] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:00.475960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa17e1-58f6-46ce-a556-b9f5b8842242 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:00.478200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.531353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.531992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.532331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.532660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.544077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:00.545632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:00.547741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:00.561361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:00.564119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:00.566202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:00.566202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:00.566202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:00.566202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 302/610] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:00.571741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.625876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:00.676781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a12da6-56b9-4bb8-b96a-8d8103d5ea09 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:00.718757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99647a79-d00f-4bef-9cba-1d7cf2cc6bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.719581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99647a79-d00f-4bef-9cba-1d7cf2cc6bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.719906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99647a79-d00f-4bef-9cba-1d7cf2cc6bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.720181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99647a79-d00f-4bef-9cba-1d7cf2cc6bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.720885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99647a79-d00f-4bef-9cba-1d7cf2cc6bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:00.726369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99647a79-d00f-4bef-9cba-1d7cf2cc6bb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:00.726369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99647a79-d00f-4bef-9cba-1d7cf2cc6bb5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:00.739978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 309/611] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:00.741700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc771c4-3af7-45e8-9bc2-12b5f7dfd898 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.741988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc771c4-3af7-45e8-9bc2-12b5f7dfd898 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.742520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc771c4-3af7-45e8-9bc2-12b5f7dfd898 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.744650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 310/612] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:00.745359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc771c4-3af7-45e8-9bc2-12b5f7dfd898 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.767193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0482d-c15f-4b8a-afff-749b0afe8b81 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:00.803878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a8799-8ee8-4e40-9280-c996261985fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.804786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8799-8ee8-4e40-9280-c996261985fc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.805329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8799-8ee8-4e40-9280-c996261985fc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.805611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8799-8ee8-4e40-9280-c996261985fc None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.806264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a8799-8ee8-4e40-9280-c996261985fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:00.806772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a8799-8ee8-4e40-9280-c996261985fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:00.808471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a8799-8ee8-4e40-9280-c996261985fc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:00.824845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 303/613] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:00.827209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61525b8-d7ef-4e91-84c2-b2c75490eab5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.827492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61525b8-d7ef-4e91-84c2-b2c75490eab5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.827816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61525b8-d7ef-4e91-84c2-b2c75490eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.852168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b61525b8-d7ef-4e91-84c2-b2c75490eab5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:00.853783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b61525b8-d7ef-4e91-84c2-b2c75490eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:00.860695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:00.873588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc771c4-3af7-45e8-9bc2-12b5f7dfd898 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:00.918210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:00.918958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:00.919539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:00.919830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/d4f75c3e044d4b0dbad6b16ea0599bab/roles/ffccef46ca484651b96df0b7a6254ff4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:00.941880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=d4f75c3e044d4b0dbad6b16ea0599bab, role_id=ffccef46ca484651b96df0b7a6254ff4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:00.943471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:00.945345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 304/614] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:00.946756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61525b8-d7ef-4e91-84c2-b2c75490eab5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:00.972771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 311/615] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:23:00 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/d4f75c3e044d4b0dbad6b16ea0599bab/roles/ffccef46ca484651b96df0b7a6254ff4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:23:00.977209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:01.100312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61525b8-d7ef-4e91-84c2-b2c75490eab5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:01.136051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:01.136756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:01.137039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:01.137315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:01.145703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:01.147247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:01.168455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:01.169728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:01.170979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 305/616] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:01.177800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:01.311811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bc5d2-57a1-42c4-9198-9c2c15126d1e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:01.334807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:01.356074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:01.356739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:01.357153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:01.357432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:01.358164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:01.358519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:01.360779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:01.389783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:01.400442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 312/617] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Sep 25 04:23:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:01.405733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:01.477103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:01.513142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995f46f-73a7-41d5-9c24-d80d14a7f97d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:01.550202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:01.550877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:01.551155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:01.551427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:01.563033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:01.568375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:01.569494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:01.570514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 306/618] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:01.577506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:01.629141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab7bb-a773-485f-b510-a006faa254fc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:01.703529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:01.704184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:01.704514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:01.704789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:01.722117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:01.723829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:01.724804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f819b9-2389-49dd-a3d3-5587d5cf4697 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:01.755010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:01.756190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:01.757052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:01.757052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:01.757052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:01.768775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 313/619] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:01.774003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:01.796328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:01.797466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:01.799294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:01.799798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:01.800853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:01.802104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:01.803836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:01.806371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:01.826570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 307/620] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:01.830949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:01.876837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:01.976680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51ba6a-f480-443f-8e47-9cb3e6dbaa97 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:02.016367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019d4ba-05eb-46a7-b624-72589d86cbbf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:02.040330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:02.040991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.041274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.041545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.042195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:02.042525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:02.043903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:02.065573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 314/621] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:02.076206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:02.089755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:02.090443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.090777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.091057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.117632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:02.120228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:02.140632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:02.141587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:02.143080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:02.143080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:02.143080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:02.143080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 308/622] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:02.147412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:02.221870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:02.287176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c6c70-0611-4b0e-82c2-2776cc78f8b5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:02.310324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408315-0c07-4cac-957c-08e9c782fb08 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:02.335536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:02.336163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.336423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.336691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.337343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:02.337639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:02.343462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:02.343997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:02.366196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 309/623] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:02.372469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:02.386758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:02.387476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.387752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.388021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.400790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:02.402262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:02.427013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:02.427955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:02.428807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:02.430553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 315/624] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:02.434863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:02.549631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c110f-3627-4176-81eb-38ade02e4269 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:02.562451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:02.595442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9541b5-23e8-474d-b662-40e87a7820b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:02.596377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9541b5-23e8-474d-b662-40e87a7820b1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.596659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9541b5-23e8-474d-b662-40e87a7820b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.596932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9541b5-23e8-474d-b662-40e87a7820b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.602715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e215f6-e7a7-452c-8802-c599932ec6b0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:02.606214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9541b5-23e8-474d-b662-40e87a7820b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:02.607701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9541b5-23e8-474d-b662-40e87a7820b1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-4f9541b5-23e8-474d-b662-40e87a7820b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:02.621957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:02.623148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:02.624098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 310/625] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:23:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:02.624697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db097618-2aab-47c9-ad3b-f2c055e122ba None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.624697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db097618-2aab-47c9-ad3b-f2c055e122ba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.624697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db097618-2aab-47c9-ad3b-f2c055e122ba None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.626594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 311/626] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:02.630540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d2287-0194-4897-9bb6-8d2b9dd5bc72 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.630540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d2287-0194-4897-9bb6-8d2b9dd5bc72 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.630540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d2287-0194-4897-9bb6-8d2b9dd5bc72 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.630540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 312/627] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:02.630863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d2287-0194-4897-9bb6-8d2b9dd5bc72 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:02.649443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03212-a06e-4785-9c67-1bef77bac21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:02.650382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03212-a06e-4785-9c67-1bef77bac21f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.650910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03212-a06e-4785-9c67-1bef77bac21f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.651350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03212-a06e-4785-9c67-1bef77bac21f None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.652261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03212-a06e-4785-9c67-1bef77bac21f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:02.652734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03212-a06e-4785-9c67-1bef77bac21f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:02.654333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03212-a06e-4785-9c67-1bef77bac21f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:02.666988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 316/628] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:02.668310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249df8-8854-418b-a0cc-fdad2ddf5dba None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.668598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249df8-8854-418b-a0cc-fdad2ddf5dba None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.668870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249df8-8854-418b-a0cc-fdad2ddf5dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.687954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-01249df8-8854-418b-a0cc-fdad2ddf5dba None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:02.689171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-01249df8-8854-418b-a0cc-fdad2ddf5dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:02.716707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:02.738672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d2287-0194-4897-9bb6-8d2b9dd5bc72 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:02.774382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 317/629] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:02.774382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088582e-349c-4151-8d10-3223f2405855 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.774382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088582e-349c-4151-8d10-3223f2405855 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.774382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088582e-349c-4151-8d10-3223f2405855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.782751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:02.783451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:02.783794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:02.784129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:02.784928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:02.785299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:02.786838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:02.791949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1088582e-349c-4151-8d10-3223f2405855 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:02.793218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1088582e-349c-4151-8d10-3223f2405855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:02.804485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 313/630] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:23:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:02.805303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:02.835073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:02.873028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 318/631] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:02.875814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088582e-349c-4151-8d10-3223f2405855 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:02.951929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74baad-2c24-4e80-ab51-bd166be8b5b5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.013883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.014933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.015427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.016082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/12819d6a0c19462d82b285502d0e27b0/roles/ffccef46ca484651b96df0b7a6254ff4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.041952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.043646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=12819d6a0c19462d82b285502d0e27b0, role_id=ffccef46ca484651b96df0b7a6254ff4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:03.045111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:03.056721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088582e-349c-4151-8d10-3223f2405855 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.070146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 314/632] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:23:02 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/12819d6a0c19462d82b285502d0e27b0/roles/ffccef46ca484651b96df0b7a6254ff4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:23:03.070810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.128360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.128989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.129332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.129651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.234000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.274673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:03.276113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47c51c-bd1a-4ca3-8b34-08a7570b287c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.276240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:03.318981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.319995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.320489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.320957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.333742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:03.338938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:03.340242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:03.341052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:03.343828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 315/633] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:03.344830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.396396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.408775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 319/634] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:23:03.410376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.451197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad67e8f-f1f3-424b-9f06-466be784260a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.485852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.486508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.486787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.487061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.489676 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.498001 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:03.503048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:03.504176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:03.505250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:03.510397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 316/635] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:03.510397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.528587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8dfd2-1254-445b-91b1-2c1222193514 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.574011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac64f9-9089-4a50-b865-90d50e83bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.574567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac64f9-9089-4a50-b865-90d50e83bee9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.574850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac64f9-9089-4a50-b865-90d50e83bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.575125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac64f9-9089-4a50-b865-90d50e83bee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.575787 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac64f9-9089-4a50-b865-90d50e83bee9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:03.576089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac64f9-9089-4a50-b865-90d50e83bee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:03.577473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac64f9-9089-4a50-b865-90d50e83bee9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:03.590671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 320/636] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:03.592797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3277b3-8792-4a77-9221-78161d1e9045 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.593222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3277b3-8792-4a77-9221-78161d1e9045 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.593503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3277b3-8792-4a77-9221-78161d1e9045 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.594973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 321/637] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:03.595534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3277b3-8792-4a77-9221-78161d1e9045 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.615089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09fd71-1923-4b37-80de-c34a49037899 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.655098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.655734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.656010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.656374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.658174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.667136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:03.668588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:03.683243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:03.684238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:03.685404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:03.685404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:03.685404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:03.685404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 317/638] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:03.685404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.713146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3277b3-8792-4a77-9221-78161d1e9045 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.739401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.749281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab149-2cb7-4c0a-a5a9-79cc4cccd86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.750469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab149-2cb7-4c0a-a5a9-79cc4cccd86d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.750792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab149-2cb7-4c0a-a5a9-79cc4cccd86d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.751251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab149-2cb7-4c0a-a5a9-79cc4cccd86d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.751693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab149-2cb7-4c0a-a5a9-79cc4cccd86d None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:03.751999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab149-2cb7-4c0a-a5a9-79cc4cccd86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:03.753481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab149-2cb7-4c0a-a5a9-79cc4cccd86d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:03.766417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 322/639] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:03.766417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c03c5-58f9-442c-90b8-59a32a49317e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.766417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c03c5-58f9-442c-90b8-59a32a49317e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.766417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c03c5-58f9-442c-90b8-59a32a49317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.782393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-737c03c5-58f9-442c-90b8-59a32a49317e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:03.783612 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-737c03c5-58f9-442c-90b8-59a32a49317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:03.798013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9110-b0fb-4ba7-abdf-64aae06dd3b4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.833541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:03.834094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:03.834393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:03.834674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:03.846852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:03.848318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:03.866103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 323/640] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:03.866103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c03c5-58f9-442c-90b8-59a32a49317e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:03.866415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:03.867268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:03.868173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:03.868173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:03.868173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:03.868173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 318/641] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:03.868173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:03.931968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.988834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c03c5-58f9-442c-90b8-59a32a49317e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:03.989053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:03.993900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19d18-c882-4ed1-b9ef-71d371ac04b0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.028175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.028872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.029217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.029556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.030278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:04.030670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.032175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.045555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 324/642] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:04.046628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.050491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.051185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.051455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.051719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.064922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.066463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:04.080960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:04.083191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:04.085360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:04.085360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:04.085360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:04.094372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 319/643] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:04.094372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.173640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9417a7-4785-441d-a9bc-225d58d11ed4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.180399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:04.194941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d37b67-46a9-4875-996f-bddd355c2d78 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.209363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.209972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.210255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.210558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.211197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:04.211499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.212869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.228726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.229356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.229492 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 325/644] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:04.229672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.229901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.230259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.238230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.240104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:04.251916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:04.252808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:04.253858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 320/645] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:04.258470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.276263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:04.345664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6c4c4-4a3b-4b89-9326-ed0ad5622f20 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.375703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b891ae0-1810-48c0-b77c-f484f8e2d236 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.381938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.382584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.382874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.383141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.383797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:04.384104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.385511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.398007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 326/646] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:04.398900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.417685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.418317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.418625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.418902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.431415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:04.433164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:04.438117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:04.439396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:04.440434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:04.444489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 321/647] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:04.445386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.511650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf367b93-6186-42ee-ae0a-02989319538c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.519683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:04.546081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.546802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.547087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.547367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.553126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ddcfa-71bd-4af9-ab23-9ce0ddc9c055 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.554691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.556143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:04.567896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:04.568984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:04.569923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 327/648] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:04.570558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.595771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.596316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.596600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.596879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.597608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:04.597917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.599401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.612647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 322/649] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:04.613437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.670044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:04.686909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063cb5f-51cf-49ea-8920-67dd25cbb64b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.721611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d0096-1303-48d1-aa22-51444a8342ea None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.723395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.724024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.724329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.724598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.732182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.733623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:04.745373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:04.746303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 328/650] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:04.747243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.758134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:04.763726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.764300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.764577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.764848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.766040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:04.766358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.767770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.781343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 323/651] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:04.781343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.857761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f3044-ad59-45f4-8f06-f5d4ef7a4d41 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.883588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ffc2-b5f1-4183-b70c-6172391ce4fc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:04.893613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.894372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.894657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.894949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.895673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:04.895995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.897926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.920571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 329/652] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:04.920571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:04.923398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:04.924089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:04.924441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:04.924794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:04.925008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:04.925726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=079636b6d56943928420801c47555aea) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:04.926204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:04.927806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:04.942385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 324/653] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/role_assignments?user.id=079636b6d56943928420801c47555aea&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:04.942385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.024525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.047314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e094f-adb2-4518-aa36-8bd53f232e67 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.076264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f604-814f-44fc-91c2-259b389f139f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.084587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.085307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.085656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.086001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.086872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:05.087347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.088809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:05.109076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 330/654] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:05.109989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.124005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.124747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.125636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.125986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.137930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.140266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:05.155787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:05.158827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:05.161135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:05.161135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:05.161135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:05.163187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 325/655] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:05.163187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.178534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.236021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bf504-a86b-4c78-acf2-2a851ff83929 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.281592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.282215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.282529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.282802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.316153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b179fd-f025-4ab0-9e4e-6c3a6223664f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.329802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.356520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730677-260b-4f0a-9f43-10ad5871913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.357146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730677-260b-4f0a-9f43-10ad5871913c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.357429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730677-260b-4f0a-9f43-10ad5871913c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.357725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730677-260b-4f0a-9f43-10ad5871913c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.362171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.363608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:05.429359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c730677-260b-4f0a-9f43-10ad5871913c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.431024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c730677-260b-4f0a-9f43-10ad5871913c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:05.431608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.474192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 331/656] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:23:05.475205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.546444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 326/657] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:23:05.546444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcfa97-6345-49a1-8371-1362864167c4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.546444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcfa97-6345-49a1-8371-1362864167c4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.546444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcfa97-6345-49a1-8371-1362864167c4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.546444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 327/658] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:05.546444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcfa97-6345-49a1-8371-1362864167c4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.558653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.593434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ccd33-ac6c-4b7d-aeb0-87d02294dc9d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.630387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.631115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.631396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.631677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.632309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:05.632611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.634304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:05.651901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 332/659] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:05.652766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.652966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcfa97-6345-49a1-8371-1362864167c4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.678628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.690465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999736e7-88e3-4aff-bcb7-8f920a648fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.691224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999736e7-88e3-4aff-bcb7-8f920a648fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.691509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999736e7-88e3-4aff-bcb7-8f920a648fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.691782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999736e7-88e3-4aff-bcb7-8f920a648fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.701955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999736e7-88e3-4aff-bcb7-8f920a648fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.703996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999736e7-88e3-4aff-bcb7-8f920a648fb3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-999736e7-88e3-4aff-bcb7-8f920a648fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:05.718636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:05.719758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:05.725333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:05.725333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:05.725333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:05.725333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 328/660] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:05.725333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251149-b086-48f8-a13e-a2b5b3a921cd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.725333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251149-b086-48f8-a13e-a2b5b3a921cd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.725333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251149-b086-48f8-a13e-a2b5b3a921cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.744243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-64251149-b086-48f8-a13e-a2b5b3a921cd None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:05.745462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-64251149-b086-48f8-a13e-a2b5b3a921cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:05.768456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cb139-ec55-45ca-aab1-09d8e99264be None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.804251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.804874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.805155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.805431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.807402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.817859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.819442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:05.819841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 329/661] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:05.820631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251149-b086-48f8-a13e-a2b5b3a921cd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:05.842276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:05.843525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:05.844637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:05.844637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:05.844637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:05.847120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 333/662] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:05.848164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:05.936058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251149-b086-48f8-a13e-a2b5b3a921cd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.938489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:05.967445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3d862-2e88-4c60-8f4c-7c40fca2c53b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:05.976796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:05.977549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:05.977953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:05.978319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:05.986436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:05.988184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:06.001262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:06.002301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 04:23:06.003480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:06.007690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 330/663] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:06.008519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.009866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.010784 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.011335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.011923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.012764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:06.013266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.014922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.029012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 334/664] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:06.030113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.065981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.115671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9cd6b-8626-4ad4-94dc-88f176395a4f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.145645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f799a-f3c5-4c1d-8ea8-1c5bf3c403b9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.149138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.149743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.150023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.150293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.150956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:06.151257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.152617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.164655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 331/665] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:06.165460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.189359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.189909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.190195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.190508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.191243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:06.191550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.192980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.194775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.212463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 335/666] 10.222.0.52 () {56 vars in 1139 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:06.213310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.281991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04067c-08f6-435d-b8fe-cccd5ea9b6d0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.295211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.319219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.319958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.320345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.320622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.326232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55377866-e5be-498e-b0a9-3ee22d56142a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.327765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.329862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:06.341478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:06.342609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 332/667] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:06.343645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.366580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.367221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.367501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.367771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.378936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:06.383771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:06.385161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 336/668] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:06.386176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.447246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.457924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ddaf-34dc-475a-ae0c-7a5e3048f918 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.494610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.495132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e194c3e-65ff-4083-a5a4-b7d26190fd7e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.495243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.495516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.495794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.502919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.504502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:06.516850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:06.517724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:06.518646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 333/669] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:06.523507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.530929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.531657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.531940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.532221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.558498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.602825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.604266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.634685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2d305-4558-4722-afa8-222844a990f0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.658750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.671315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.672327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.672792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.673246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.674567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:06.675102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.677290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.695868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 334/670] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:06.695868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.721462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 337/671] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:23:06.722473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.794413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.805328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6725ed-4841-4e7b-9434-8af51b3572ed None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.828420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa037ab-a2a4-4cb2-b938-4079570851d3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.840084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.840779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.841132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.841479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.842216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:06.842625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.844595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.857084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 335/672] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:06.857084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.869428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.870141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.870494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.870827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.871598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:06.871959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:06.873468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:06.889673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 338/673] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:06.889673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:06.902999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:06.963187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665b83-f594-413f-b488-c114b9c00515 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.993490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5b03-aaf0-49de-bd51-795f81903d0c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:06.996766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:06.997453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:06.997809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:06.998156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:06.998978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=f955275faf8349fc8d42068bd774ad10) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:06.999366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.001440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.007499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 336/674] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/role_assignments?user.id=f955275faf8349fc8d42068bd774ad10&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:07.008417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.045302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:07.055022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.056479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.056914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.057604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.073556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.075837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:07.100211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:07.101411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:07.102518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:07.102518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:07.102518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:07.109386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 339/675] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:07.109386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.158173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb2201-3ffe-4063-bc31-e3b1c1ff52dd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.196013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:07.215470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.216113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.216395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.216669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.229562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.231118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.241024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021db8-082c-4de3-85e9-391a81fc2cab None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:07.246582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:07.247711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:07.248826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:07.248826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:07.248826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:07.250278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 337/676] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:07.251260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.286190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdba7e-02dc-4c66-be63-e0f8bbffa385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.286829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdba7e-02dc-4c66-be63-e0f8bbffa385 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.287106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdba7e-02dc-4c66-be63-e0f8bbffa385 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.287374 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdba7e-02dc-4c66-be63-e0f8bbffa385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.288105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdba7e-02dc-4c66-be63-e0f8bbffa385 None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=78f639af7ae54e06b8baa10e77236c8c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:07.288406 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdba7e-02dc-4c66-be63-e0f8bbffa385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.289829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdba7e-02dc-4c66-be63-e0f8bbffa385 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.296871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 340/677] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/role_assignments?user.id=78f639af7ae54e06b8baa10e77236c8c&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:07.298239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906ed9-8a09-4e0f-a9d3-00dd0ebeccea None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.298548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906ed9-8a09-4e0f-a9d3-00dd0ebeccea None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.298822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906ed9-8a09-4e0f-a9d3-00dd0ebeccea None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.300144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 341/678] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:07.300702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906ed9-8a09-4e0f-a9d3-00dd0ebeccea None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.344841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:07.393710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4b51-9e6a-4687-b563-106d6ec79db3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.433175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906ed9-8a09-4e0f-a9d3-00dd0ebeccea None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.438763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eae932-f32e-4aef-84d4-72fd5b5d7d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.439401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae932-f32e-4aef-84d4-72fd5b5d7d20 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.439685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae932-f32e-4aef-84d4-72fd5b5d7d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.439961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae932-f32e-4aef-84d4-72fd5b5d7d20 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.440629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eae932-f32e-4aef-84d4-72fd5b5d7d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:07.440939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eae932-f32e-4aef-84d4-72fd5b5d7d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.442519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eae932-f32e-4aef-84d4-72fd5b5d7d20 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.461424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 338/679] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:07.463029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264147ea-27c4-40e4-bcf7-b86cabe287d3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.463326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264147ea-27c4-40e4-bcf7-b86cabe287d3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.463685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:07.464724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264147ea-27c4-40e4-bcf7-b86cabe287d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.473463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.475013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.475013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.475013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.475401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:07.475700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.477102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.487062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-264147ea-27c4-40e4-bcf7-b86cabe287d3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:07.488523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-264147ea-27c4-40e4-bcf7-b86cabe287d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:07.490579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 342/680] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:07.491536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.568603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 339/681] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:07.569673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264147ea-27c4-40e4-bcf7-b86cabe287d3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.617944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049129b9-3ebd-4b4d-9d0e-9928e946369b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.640604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:07.661148 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.662114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.662889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.663633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.673446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.674955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:07.687798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:07.689229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:07.690302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 343/682] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:07.694802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.696451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264147ea-27c4-40e4-bcf7-b86cabe287d3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.741097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.742183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.742685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.743463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.750648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:07.753697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.755401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:07.771328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:07.772277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:07.773213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:07.775985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 340/683] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:07.782178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.818379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cd6fa-9430-46aa-b9db-004f412a3cc0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.881017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.881637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.881915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.882191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.884716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:07.885025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.886510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.903857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 344/684] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:07.904855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:07.930683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e30e0-8a11-4130-aaf4-3f8618a35f84 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:07.951848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:07.967792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:07.968430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:07.969253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:07.969582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:07.970429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:07.970809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:07.972252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:07.991651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 341/685] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:07.992576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:08.041804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7cf37-c574-44a4-a801-a4688af2abff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:08.053840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:08.091085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:08.091775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:08.092295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:08.092578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:08.106160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:08.110859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a6b9-6dc9-489b-aa2a-66e310248599 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:08.112942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:08.114037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:08.115071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 345/686] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:08.115920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:08.161978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:08.162604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:08.162883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:08.163156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:08.163882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=d4f75c3e044d4b0dbad6b16ea0599bab) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:08.164188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:08.165614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:08.178529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 342/687] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:07 2022] GET /identity/v3/role_assignments?user.id=d4f75c3e044d4b0dbad6b16ea0599bab&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:08.178529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:08.270464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:08.311987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b94df8-1a05-4c1f-85f1-da530b58c946 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:08.389328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39099a7-86a6-4024-86f2-f2021849f236 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:08.393108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:08.393731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:08.394006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:08.394276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:08.431758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:08.431966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:08.432171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:08.432365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:08.433060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:08.433339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:08.434732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:08.438061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:08.447286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 343/688] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:08.455378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:08.492436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:08.494083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:08.574538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aedd5-cb9e-451c-912a-042a93dc4dc9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:08.577436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:08.621737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:08.622539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:08.622821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:08.623147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:08.631375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 346/689] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:23:08.636070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:08.637116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:08.637532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:08.653774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:08.654938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:08.656098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:08.656098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:08.656098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:08.658835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 344/690] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:08.661624 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:08.776833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3992648-7f60-495e-9873-19915e09f39d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:08.799269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:08.823845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:08.824708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:08.825133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:08.825579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:08.826390 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:08.826837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:08.828509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:08.856918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 345/691] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:08.869873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b25c-63e5-4a21-9a27-729de31b4f6d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:08.879803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:08.910473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:08.949474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:08.950371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:08.950798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:08.951231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:08.962981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:08.964991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:08.982373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:08.983622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:08.984789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:08.984789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:08.984789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:08.986510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 347/692] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:08.996913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:09.080154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9d0e-04bc-4f05-86f2-1d23722e0d87 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:09.141191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:09.142419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.142898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.143501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.159543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:09.160903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:09.165865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a535fb-92e8-4795-a06f-62df7ec52816 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:09.183318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:09.184261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:09.185436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:09.188319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 346/693] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:23:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:09.198408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:09.201346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:09.229514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:09.230137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.230444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.230720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.231366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:09.231668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:09.233141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:09.262181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 348/694] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:09.271584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:09.291799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:09.318998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425f012-b8f5-4933-b9d5-cb3eb559b224 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:09.355903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:09.356700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.357091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.357470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.358314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:09.358836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:09.361029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:09.381536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 347/695] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:23:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:09.387039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:09.460154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8320219-0da8-4946-81d5-b3bfac75e8f3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:09.515879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69745db-f3a3-4f4c-bbd6-2104973409ac None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:09.536475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:09.537118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.537392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.537661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.549258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:09.550733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:09.552532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fdf94-b85a-466a-9849-206669a25c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:09.553209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fdf94-b85a-466a-9849-206669a25c97 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.553497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fdf94-b85a-466a-9849-206669a25c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.553775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fdf94-b85a-466a-9849-206669a25c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.556420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:09.578799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:09.579718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:09.580617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 349/696] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:09.591280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:09.635091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fdf94-b85a-466a-9849-206669a25c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:09.635736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:09.637907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fdf94-b85a-466a-9849-206669a25c97 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:09.711243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab596e-fa27-4698-aba1-368e9399163f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:09.745970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbf26c-9086-4b45-bbd3-6a2b3a0c8ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:09.746624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf26c-9086-4b45-bbd3-6a2b3a0c8ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.746901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf26c-9086-4b45-bbd3-6a2b3a0c8ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.747175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf26c-9086-4b45-bbd3-6a2b3a0c8ab8 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.747863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbf26c-9086-4b45-bbd3-6a2b3a0c8ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:09.748165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbf26c-9086-4b45-bbd3-6a2b3a0c8ab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:09.750120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbf26c-9086-4b45-bbd3-6a2b3a0c8ab8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:09.754423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 348/697] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 04:23:09.755766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39194aee-1ed6-4345-af82-be386b526424 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.756056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39194aee-1ed6-4345-af82-be386b526424 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.756334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39194aee-1ed6-4345-af82-be386b526424 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.757995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 349/698] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:09.758729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39194aee-1ed6-4345-af82-be386b526424 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:09.770283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 350/699] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:09.771878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b9bf-9dc6-4ce9-a055-d65a65d2ecac None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.772377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b9bf-9dc6-4ce9-a055-d65a65d2ecac None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.772872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b9bf-9dc6-4ce9-a055-d65a65d2ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.793249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a557b9bf-9dc6-4ce9-a055-d65a65d2ecac None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:09.795094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a557b9bf-9dc6-4ce9-a055-d65a65d2ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:09.806549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:09.874258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 351/700] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:09.875848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b9bf-9dc6-4ce9-a055-d65a65d2ecac None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:09.896667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39194aee-1ed6-4345-af82-be386b526424 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:09.935243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46d65-9a59-44a0-855d-f8ef0c81e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:09.935447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:09.935976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46d65-9a59-44a0-855d-f8ef0c81e114 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.935976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46d65-9a59-44a0-855d-f8ef0c81e114 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.936261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46d65-9a59-44a0-855d-f8ef0c81e114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.946929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46d65-9a59-44a0-855d-f8ef0c81e114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:09.948421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46d65-9a59-44a0-855d-f8ef0c81e114 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-c6a46d65-9a59-44a0-855d-f8ef0c81e114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:09.963912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:09.964894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:09.965776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:09.965776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:09.965776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:09.965776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 350/701] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:09.966607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f941-458a-4b0e-9a55-c4f2f1f9ba86 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:09.966888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f941-458a-4b0e-9a55-c4f2f1f9ba86 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:09.967565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f941-458a-4b0e-9a55-c4f2f1f9ba86 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:09.973201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 351/702] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:09.973982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88f941-458a-4b0e-9a55-c4f2f1f9ba86 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.011434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b9bf-9dc6-4ce9-a055-d65a65d2ecac None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.060564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135a6ad-ee18-46d0-b470-78b8760f0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.062253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135a6ad-ee18-46d0-b470-78b8760f0401 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.062739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135a6ad-ee18-46d0-b470-78b8760f0401 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.063165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135a6ad-ee18-46d0-b470-78b8760f0401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.064031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135a6ad-ee18-46d0-b470-78b8760f0401 None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=12819d6a0c19462d82b285502d0e27b0) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:10.064490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135a6ad-ee18-46d0-b470-78b8760f0401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.066084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135a6ad-ee18-46d0-b470-78b8760f0401 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.074706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 352/703] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:09 2022] GET /identity/v3/role_assignments?user.id=12819d6a0c19462d82b285502d0e27b0&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:10.076378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c941-8f64-495f-a3d9-9cf51cca4fb3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.076815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c941-8f64-495f-a3d9-9cf51cca4fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.077545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c941-8f64-495f-a3d9-9cf51cca4fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.079261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:10.099770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88f941-458a-4b0e-9a55-c4f2f1f9ba86 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.103291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f682c941-8f64-495f-a3d9-9cf51cca4fb3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:10.104770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f682c941-8f64-495f-a3d9-9cf51cca4fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:10.138904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.139704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.140085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.140965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.141691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:10.142000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.143438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.158686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 352/704] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:10.159606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.181581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 353/705] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:10.191010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c941-8f64-495f-a3d9-9cf51cca4fb3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.232087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:10.291490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2f8c6-d777-4896-8615-02fa57e657b7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.339001 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.339695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.339984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.340251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.340841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.342209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.353141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c941-8f64-495f-a3d9-9cf51cca4fb3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:10.354015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:10.355024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:10.355859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 353/706] 10.222.0.52 () {56 vars in 1129 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:10.361390 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.380446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:10.396295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.397110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.397555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.397967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.405198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.407372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:10.421038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:10.422013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:10.422911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 354/707] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:10.435923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.496611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4d35-3062-4048-87d6-4bf1af5538b9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.550430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.551746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.552237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.552962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.554002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:10.554541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.555141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:10.556500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.562884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 354/708] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:10.568394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.572543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9524-9fa6-4c84-ab41-3863ad7d787a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.612815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.613426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.614379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.614379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.614666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:10.614970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.616394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.629065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 355/709] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:10.630006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.658385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:10.686433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe307fb-c7df-4341-9e50-43d74e8fc917 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.722797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.723652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.723958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.724299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.725016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:10.725389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.726974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.742380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 355/710] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:10.742380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.762618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd9ab-4805-4d77-bf66-f144f6b15268 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.839616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb9575-9df5-401f-b931-7f6772da8a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.840261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9575-9df5-401f-b931-7f6772da8a28 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.840703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9575-9df5-401f-b931-7f6772da8a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.840986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9575-9df5-401f-b931-7f6772da8a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.855367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb9575-9df5-401f-b931-7f6772da8a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.857405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb9575-9df5-401f-b931-7f6772da8a28 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.861104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fadb9575-9df5-401f-b931-7f6772da8a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:10.879275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:10.880305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:10.881151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:10.881151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:10.881151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:10.881151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 356/711] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:10.882048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0a31-e2cd-4965-bcb2-4ec0c24ff47f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.882424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0a31-e2cd-4965-bcb2-4ec0c24ff47f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.882703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0a31-e2cd-4965-bcb2-4ec0c24ff47f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.887889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 357/712] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:10.889464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa01f9-5dc4-4965-9b35-018801d014f0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.889748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa01f9-5dc4-4965-9b35-018801d014f0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.890055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa01f9-5dc4-4965-9b35-018801d014f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.914202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c8fa01f9-5dc4-4965-9b35-018801d014f0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:10.915534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8fa01f9-5dc4-4965-9b35-018801d014f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:10.931096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967830-32c9-478a-a3e7-fde576db4272 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:10.974462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:10.974462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:10.974726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:10.974815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:10.975512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=079636b6d56943928420801c47555aea) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:10.975818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:10.977317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:10.982806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 356/713] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/role_assignments?user.id=079636b6d56943928420801c47555aea&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:10.983686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:10.986601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:11.037416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 358/714] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:11.121150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb42b-15a9-4ecd-b068-ae72e9cc900b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:11.165906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:11.166554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:11.166836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:11.167106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:11.167759 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:11.168058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:11.169420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:11.182597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 357/715] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:11.188676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa01f9-5dc4-4965-9b35-018801d014f0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:11.304676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa01f9-5dc4-4965-9b35-018801d014f0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:11.334737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:11.339572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:11.340514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:11.340831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:11.341110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:11.341836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:11.343866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:11.374313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 359/716] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:23:11 2022] POST /identity/v3/users => generated 254 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:11.375664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:11.500975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:11.548127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762a704-a5e2-496c-a161-b917f75be1a6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:11.595740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:11.596459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:11.596742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:11.597014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] PATH_INFO: `/v3/services/network` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:11.597611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:11.599008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:11.611567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:11.612576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:11.613393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:11.614116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 358/717] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:11 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:11.618553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:11.724091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d894c7-1e77-4f7d-9c6b-0398408d2090 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:11.758897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda1e4-a26e-4240-8faf-e126bd1668fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:11.759520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda1e4-a26e-4240-8faf-e126bd1668fb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:11.759848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda1e4-a26e-4240-8faf-e126bd1668fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:11.760127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda1e4-a26e-4240-8faf-e126bd1668fb None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:11.760760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda1e4-a26e-4240-8faf-e126bd1668fb None admin] RBAC: Adding query filter params (name=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:11.761062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda1e4-a26e-4240-8faf-e126bd1668fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:11.762458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda1e4-a26e-4240-8faf-e126bd1668fb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:11.768129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 360/718] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:11.775425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:11.881824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaaf58-72e1-42df-8c1b-395631bf4755 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:11.910105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:11.922495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb34e3-f547-4ecd-a434-566af07b9adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:11.923111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb34e3-f547-4ecd-a434-566af07b9adf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:11.923389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb34e3-f547-4ecd-a434-566af07b9adf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:11.923663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb34e3-f547-4ecd-a434-566af07b9adf None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:11.924297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb34e3-f547-4ecd-a434-566af07b9adf None admin] RBAC: Adding query filter params (type=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:11.924597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb34e3-f547-4ecd-a434-566af07b9adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:11.925968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb34e3-f547-4ecd-a434-566af07b9adf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:11.932002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 359/719] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:12.727754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a8d9b-a54f-4bcc-a577-e2bceafcbce4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:12.728792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a8d9b-a54f-4bcc-a577-e2bceafcbce4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:12.729283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a8d9b-a54f-4bcc-a577-e2bceafcbce4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:12.731105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 361/720] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:12.736861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afd715-363a-46db-bb0d-57392120851b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:12.737384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afd715-363a-46db-bb0d-57392120851b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:12.737862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afd715-363a-46db-bb0d-57392120851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:12.756758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-34afd715-363a-46db-bb0d-57392120851b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:12.758267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-34afd715-363a-46db-bb0d-57392120851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:12.848294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 360/721] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:13.246031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a8d9b-a54f-4bcc-a577-e2bceafcbce4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:13.309624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:13.377302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a8d9b-a54f-4bcc-a577-e2bceafcbce4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:13.417561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa676b41-a951-4892-a299-00382455e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:13.418631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676b41-a951-4892-a299-00382455e958 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:13.419116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676b41-a951-4892-a299-00382455e958 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:13.419610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676b41-a951-4892-a299-00382455e958 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:13.430927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa676b41-a951-4892-a299-00382455e958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-aa676b41-a951-4892-a299-00382455e958 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:13.436763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:13.438214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:13.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:13.441599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 362/722] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:13.447459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afd715-363a-46db-bb0d-57392120851b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:13.514407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac1deb-ee09-4088-82a7-a81493b9a4ff None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:13.514996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac1deb-ee09-4088-82a7-a81493b9a4ff None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:13.515569 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac1deb-ee09-4088-82a7-a81493b9a4ff None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:13.517368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 363/723] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:13.522792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183edb3-ce95-4ac1-9018-a117db0f96c5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:13.523384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183edb3-ce95-4ac1-9018-a117db0f96c5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:13.523857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183edb3-ce95-4ac1-9018-a117db0f96c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:13.547354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d183edb3-ce95-4ac1-9018-a117db0f96c5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:13.548904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d183edb3-ce95-4ac1-9018-a117db0f96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:13.609888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afd715-363a-46db-bb0d-57392120851b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:13.649140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2cc9b-cecd-4cb2-abd7-d831e0fe2aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:13.650141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cc9b-cecd-4cb2-abd7-d831e0fe2aae None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:13.650665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cc9b-cecd-4cb2-abd7-d831e0fe2aae None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:13.651142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cc9b-cecd-4cb2-abd7-d831e0fe2aae None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:13.652306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2cc9b-cecd-4cb2-abd7-d831e0fe2aae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:13.652849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2cc9b-cecd-4cb2-abd7-d831e0fe2aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:13.654461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2cc9b-cecd-4cb2-abd7-d831e0fe2aae None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:13.662677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:13.672289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 364/724] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:23:13.677671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 361/725] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:13.678791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183edb3-ce95-4ac1-9018-a117db0f96c5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:13.688234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc401b0-6ef4-4e16-8aca-65cd5a9a59f4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:13.688514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc401b0-6ef4-4e16-8aca-65cd5a9a59f4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:13.688785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc401b0-6ef4-4e16-8aca-65cd5a9a59f4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:13.690337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 362/726] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:13.694950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68481b89-eef6-4ed8-8093-3ef9d1fead86 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:13.695226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68481b89-eef6-4ed8-8093-3ef9d1fead86 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:13.695496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68481b89-eef6-4ed8-8093-3ef9d1fead86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:13.713621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-68481b89-eef6-4ed8-8093-3ef9d1fead86 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:13.714834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-68481b89-eef6-4ed8-8093-3ef9d1fead86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:13.739042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:13.802458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 363/727] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 04:23:13.858111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183edb3-ce95-4ac1-9018-a117db0f96c5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:13.918278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:13.918936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:13.919267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:13.919542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:13.930062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:13.931942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:13.954330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:13.955330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:13.956201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:13.956201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:13.956201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:13.956201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 365/728] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:13.962488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68481b89-eef6-4ed8-8093-3ef9d1fead86 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:13.975023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:14.122244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:14.132133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68481b89-eef6-4ed8-8093-3ef9d1fead86 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.136364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af610-f5ae-485c-8e9f-13bc9e0b5ced None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.149530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:14.174446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.175118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.175403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.175684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.176546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:14.177425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.177915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:14.178154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.178526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.178911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.179621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:14.179985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:14.181674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:14.196540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 364/729] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:14.197660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:14.198402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 366/730] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:13 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:14.214570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:14.308653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3f8a-46d6-4ad1-8ded-813a63d6e6cb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.364189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.364874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.365124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.365396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.377928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:14.382938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:14.383882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:14.384700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 365/731] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:14.392534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:14.428183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:14.489978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82186f44-0d5b-4a42-8783-b83daf1d9c4a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.520506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b10244-d9d4-4d65-bbf3-3e7e0a466ba3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.539422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8287b-94e3-461f-9879-faed95667aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.539751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8287b-94e3-461f-9879-faed95667aeb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.541355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8287b-94e3-461f-9879-faed95667aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.541355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8287b-94e3-461f-9879-faed95667aeb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.552100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8287b-94e3-461f-9879-faed95667aeb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:14.554189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8287b-94e3-461f-9879-faed95667aeb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:14.558207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59540012-7907-495d-b46b-08982c0e4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.558985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59540012-7907-495d-b46b-08982c0e4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.559365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59540012-7907-495d-b46b-08982c0e4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.559736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59540012-7907-495d-b46b-08982c0e4bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.560760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59540012-7907-495d-b46b-08982c0e4bd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:14.561133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59540012-7907-495d-b46b-08982c0e4bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:14.562653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59540012-7907-495d-b46b-08982c0e4bd6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-05f8287b-94e3-461f-9879-faed95667aeb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:14.567277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:14.568443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:14.569469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:14.569997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 367/732] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:14.575582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f97424-52e0-4707-95ba-c63c01760c1e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.575868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f97424-52e0-4707-95ba-c63c01760c1e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.576138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f97424-52e0-4707-95ba-c63c01760c1e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.577532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 368/733] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:14.580378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 366/734] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:14.581043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f97424-52e0-4707-95ba-c63c01760c1e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:14.584464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05ab0-61e8-4f19-8b7d-ff35676b7cbe None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.584722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05ab0-61e8-4f19-8b7d-ff35676b7cbe None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.585000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05ab0-61e8-4f19-8b7d-ff35676b7cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.600542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:14.603476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-32e05ab0-61e8-4f19-8b7d-ff35676b7cbe None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:14.604731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-32e05ab0-61e8-4f19-8b7d-ff35676b7cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:14.690455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 367/735] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:14.690455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05ab0-61e8-4f19-8b7d-ff35676b7cbe None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:14.726746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:14.744371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f97424-52e0-4707-95ba-c63c01760c1e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.782978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50442e88-dfda-4ad8-9d7e-63d5cf2d619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.783585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442e88-dfda-4ad8-9d7e-63d5cf2d619e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.783863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442e88-dfda-4ad8-9d7e-63d5cf2d619e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.784136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442e88-dfda-4ad8-9d7e-63d5cf2d619e None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.784861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50442e88-dfda-4ad8-9d7e-63d5cf2d619e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:14.785194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50442e88-dfda-4ad8-9d7e-63d5cf2d619e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:14.786656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50442e88-dfda-4ad8-9d7e-63d5cf2d619e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:14.804524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 369/736] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Sep 25 04:23:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:14.805914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d1ac-3ed0-47a4-a0ec-fa8e563bef9b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.806201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d1ac-3ed0-47a4-a0ec-fa8e563bef9b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.806520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d1ac-3ed0-47a4-a0ec-fa8e563bef9b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.808004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 370/737] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:14.809854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d1ac-3ed0-47a4-a0ec-fa8e563bef9b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:14.845226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05ab0-61e8-4f19-8b7d-ff35676b7cbe None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.886939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:14.887285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485b75b-842f-492c-8dbc-2c3a85acdfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.887949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485b75b-842f-492c-8dbc-2c3a85acdfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.888343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485b75b-842f-492c-8dbc-2c3a85acdfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.888489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485b75b-842f-492c-8dbc-2c3a85acdfc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.900783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485b75b-842f-492c-8dbc-2c3a85acdfc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:14.902392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485b75b-842f-492c-8dbc-2c3a85acdfc4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2485b75b-842f-492c-8dbc-2c3a85acdfc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:14.918921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:14.920176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:14.921255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:14.921255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:14.921255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:14.921255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 368/738] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:14.921255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59c2e-b788-4373-a944-e2a46982ed55 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.922149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59c2e-b788-4373-a944-e2a46982ed55 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.922269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59c2e-b788-4373-a944-e2a46982ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:14.930470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d1ac-3ed0-47a4-a0ec-fa8e563bef9b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:14.946432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9ec59c2e-b788-4373-a944-e2a46982ed55 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:14.947607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9ec59c2e-b788-4373-a944-e2a46982ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:14.966902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:14.967755 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:14.968695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:14.969110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.030373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 369/739] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 04:23:15.030373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec59c2e-b788-4373-a944-e2a46982ed55 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.030373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.058573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.060629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.140679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.144389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec59c2e-b788-4373-a944-e2a46982ed55 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.179690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 371/740] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 04:23:15.180743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.191107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.192180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.192475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.192755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.193802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:15.194127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.195829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.212735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 370/741] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:15.213498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.305755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.308930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2872b10-b760-43e1-9d23-d1d249e12b29 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.345523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.346092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.346396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.346711 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.350196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b4b6e-ebc3-48fc-a77a-73debf201ae3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.356623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:15.361438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:15.362376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:15.363229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 372/742] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:15.363906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.391124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.391765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.391912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.392058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.392317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.403247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.404694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:15.418610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:15.419529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:15.420422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:15.420422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:15.420422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:15.420422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 371/743] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:15.421038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.472253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ee0c8-179e-4880-9a18-d3820596857c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.506331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.507204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.507332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.507512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.514965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.516934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:15.528436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:15.529332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 373/744] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:15.530264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.536900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d878-b470-48a2-a8f4-2548a5f56a51 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.550718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.577721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.578750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.579034 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.579311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.580307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.581717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.602401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 372/745] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:15 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:15.602401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.633890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.660697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038eab-4c64-4cd6-8cd6-f5f819cf0ef0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.723659 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.724812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.725191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.725561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.726665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:15.727073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.728923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.745643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 374/746] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:15.745643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.756263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22193f9-2779-4e89-b554-ff094001e75f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.806918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.807677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.808236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.809903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.810931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:15.813166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.815117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.827797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 373/747] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:15.828732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.877963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.880769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36acc94-49d3-4587-bc32-25afce3b2502 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:15.920744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:15.922224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:15.922658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:15.923754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:15.924531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:15.924873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:15.926380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:15.950102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 375/748] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:15.952283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:15.956733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:15.967476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aec89b-40d5-4a03-ac91-0d8874340b9f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.017841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.018500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.018785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.019062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.033381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.035252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:16.055730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:16.056691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:16.057584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:16.057584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:16.057584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:16.058180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 374/749] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:16.059071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.075062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589458-9d93-4102-b249-2b589c44bc17 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.123724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.124552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.124967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.125282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.132800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.134283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:16.147450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:16.149476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:16.151605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:16.157340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 376/750] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:16.157340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.169857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:16.192542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe0191-726d-4995-9ed2-1d05168b73c6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.225197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:16.238923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.239567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.239854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.240135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.254696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.259172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.277395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9599-4980-4771-a0f7-1217da3e6351 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:16.277546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:16.278455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:16.279307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:16.279307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:16.279307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:16.279307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 375/751] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:16.279974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.324558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.325932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.326714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.327248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.328940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:16.329911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.332131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.348776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 377/752] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:16.350762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.387712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a42fb-83aa-40eb-ab21-7eb77346f551 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.423498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.424266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.424611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.424991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.425812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:16.426179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.427736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.436544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:16.449615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 376/753] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:16.451203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.491889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43764e72-d1e5-4a9b-8e11-f663525d440a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.518833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:16.533660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.534870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.536254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.536738 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.537588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:16.538112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.539876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.557583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 378/754] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:16.558735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.571468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d924f-bfb8-483e-b8f6-02d2ef14a7d3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.608538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d9fe9-8a1f-458a-807b-c09b9d72165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.609895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d9fe9-8a1f-458a-807b-c09b9d72165f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.610006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d9fe9-8a1f-458a-807b-c09b9d72165f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.610280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d9fe9-8a1f-458a-807b-c09b9d72165f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.617728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d9fe9-8a1f-458a-807b-c09b9d72165f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.619194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d9fe9-8a1f-458a-807b-c09b9d72165f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-cb0d9fe9-8a1f-458a-807b-c09b9d72165f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:16.631257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:16.632154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:16.633070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 377/755] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:16.634376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad17c-d54a-45f4-a25f-1e989c5430df None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.634376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad17c-d54a-45f4-a25f-1e989c5430df None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.634376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad17c-d54a-45f4-a25f-1e989c5430df None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.639485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 378/756] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:16.639485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ad17c-d54a-45f4-a25f-1e989c5430df None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.677048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27163-860d-4319-92dc-51cbdd0a08ad None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.698790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:16.716946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.717637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.717838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.718083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.719428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=12819d6a0c19462d82b285502d0e27b0) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:16.719738 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.721165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.726539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 379/757] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/role_assignments?user.id=12819d6a0c19462d82b285502d0e27b0&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:16.727329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.761777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ad17c-d54a-45f4-a25f-1e989c5430df None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.778992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:16.811707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc316cd-2794-4b3c-9f2e-c5d9072870fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.813563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc316cd-2794-4b3c-9f2e-c5d9072870fc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.814127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc316cd-2794-4b3c-9f2e-c5d9072870fc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.814626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc316cd-2794-4b3c-9f2e-c5d9072870fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.825630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc316cd-2794-4b3c-9f2e-c5d9072870fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.828862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc316cd-2794-4b3c-9f2e-c5d9072870fc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.841746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25c932-4113-443e-852f-aa01ee995a56 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0dc316cd-2794-4b3c-9f2e-c5d9072870fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:16.847653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:16.848603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:16.849468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:16.852695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 379/758] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:16.855269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1faa-d847-4e4a-a1c0-c1f3b17cab11 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.855940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1faa-d847-4e4a-a1c0-c1f3b17cab11 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.856542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1faa-d847-4e4a-a1c0-c1f3b17cab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.881268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6ebf1faa-d847-4e4a-a1c0-c1f3b17cab11 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:16.883224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6ebf1faa-d847-4e4a-a1c0-c1f3b17cab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:16.884235 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:16.884860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:16.885141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:16.885418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:16.886160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:16.886501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:16.887994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:16.916043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 380/759] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:16.917071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:16.990436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 380/760] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:16.990436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1faa-d847-4e4a-a1c0-c1f3b17cab11 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:17.068465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317c277-0eca-4f1b-bcfb-6ec74a864d0f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.076557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:17.078632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:17.139489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.140145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.140423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.140696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.141398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:17.141701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.143150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.163372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 381/761] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:17.167906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:17.177161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1faa-d847-4e4a-a1c0-c1f3b17cab11 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.246225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.246873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.247155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.247431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.326152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.327837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.356511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7bbd-3b22-4aff-9396-cd941f085eee None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.379689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:17.396395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.397522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.398050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.398627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/079636b6d56943928420801c47555aea/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.400863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=079636b6d56943928420801c47555aea, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.402648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.417528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 382/762] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:23:17 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/079636b6d56943928420801c47555aea/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:23:17.418829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:17.450793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:17.454971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 381/763] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:23:17.460316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:17.536538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050725a-afe8-4721-8085-2707fc092226 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.577334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.578420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.579081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.579558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.580516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.582142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:17.594865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:17.595899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:17.596705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:17.603738 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 383/764] 10.222.0.52 () {56 vars in 1129 bytes} [Sun Sep 25 04:23:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:17.606467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:17.678596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acbefb-43b9-4042-9bf7-3653bd079702 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.711708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:17.724424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.725062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.725343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.725445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffaa5-d6ec-4dfa-a591-8cff297e6110 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.725618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.737941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.739427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.752401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:17.765650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:17.766719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:17.767575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:17.767575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:17.767575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:17.770113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.770830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.771117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.771352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 382/765] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:17.771452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.772043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:17.772418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.773864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.777005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:17.779867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 384/766] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Sep 25 04:23:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:17.789572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:17.939903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809a989-0ebe-4dd9-b8b7-c4b817da4f84 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.953396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e474db-dacd-4457-912e-8ccb33fed0de None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:17.977187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85336bae-b749-4ef6-a4ed-579d5909ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.977891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336bae-b749-4ef6-a4ed-579d5909ee96 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.978240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336bae-b749-4ef6-a4ed-579d5909ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.978601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336bae-b749-4ef6-a4ed-579d5909ee96 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.979315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336bae-b749-4ef6-a4ed-579d5909ee96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:17.979686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336bae-b749-4ef6-a4ed-579d5909ee96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.981120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336bae-b749-4ef6-a4ed-579d5909ee96 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.990039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35476ee-e91f-4021-9c49-07914dbcc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:17.990696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35476ee-e91f-4021-9c49-07914dbcc629 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.990982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35476ee-e91f-4021-9c49-07914dbcc629 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.991258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35476ee-e91f-4021-9c49-07914dbcc629 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.991884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35476ee-e91f-4021-9c49-07914dbcc629 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:17.992187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35476ee-e91f-4021-9c49-07914dbcc629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:17.993542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35476ee-e91f-4021-9c49-07914dbcc629 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:17.994890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 383/767] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:17.996146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f051e5-d59b-4a71-b148-35fb0b715331 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:17.996501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f051e5-d59b-4a71-b148-35fb0b715331 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:17.996840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f051e5-d59b-4a71-b148-35fb0b715331 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:17.998368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 384/768] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:18.005607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 385/769] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Sep 25 04:23:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:18.011311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f051e5-d59b-4a71-b148-35fb0b715331 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.011750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f531c-d73e-4f1d-93ed-95ce587b271c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.011959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f531c-d73e-4f1d-93ed-95ce587b271c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.012360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f531c-d73e-4f1d-93ed-95ce587b271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.031418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2c3f531c-d73e-4f1d-93ed-95ce587b271c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:18.032743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c3f531c-d73e-4f1d-93ed-95ce587b271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:18.044830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:18.091056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:18.111316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 386/770] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:18.112541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f531c-d73e-4f1d-93ed-95ce587b271c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.166570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f051e5-d59b-4a71-b148-35fb0b715331 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:18.230381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:18.231298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.231755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.232806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.246728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:18.250137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:18.283250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:18.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:18.285481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:18.289958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 385/771] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:18.297661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.315155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f531c-d73e-4f1d-93ed-95ce587b271c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:18.380059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:18.380921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.381372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.381792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.382666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] RBAC: Adding query filter params (interface=public, service_id=843ce35368ba4380be6598bb9c685dd0, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:18.383186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:18.384902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:18.401302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 387/772] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/endpoints?service_id=843ce35368ba4380be6598bb9c685dd0&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:18.406468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.424419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:18.460379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba649910-d07e-4e73-9d31-9604b7438022 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:18.482147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:18.498298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:18.498948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.499229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.499716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.500417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:18.500732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:18.502419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:18.517280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 386/773] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:18.522425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.545418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b3e58-99ff-4c10-9641-0a5cce31993f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:18.597965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:18.598771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.599149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.599525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.600231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:18.602251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:18.609971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 388/774] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:18.611064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.630664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82a195-60e1-4680-a876-f9459d81d43e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:18.678982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:18.679644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.679923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.680193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.680790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:18.682183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:18.701046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:18.703740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:18.705700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 387/775] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:18.714395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.764166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:18.787669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:18.840058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04708-ae1b-42a5-99c4-e5ee6cc9bb52 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:18.850655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e33f3-bbc6-4574-956a-08761bb8b9d2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:18.887662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:18.890300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.890300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.890300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.890300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] RBAC: Adding query filter params (name=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:18.890300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:18.891257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:18.896317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 388/776] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:18.902174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:18.912494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:18.913432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:18.914485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:18.914989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:18.916381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=7edd6fd40289457d94e4ae4b7a26be80) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:18.916910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:18.919290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:18.927721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 389/777] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/role_assignments?user.id=7edd6fd40289457d94e4ae4b7a26be80&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:19.075554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d74d7-c5cf-489a-80f4-de2f213ff075 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:19.091360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:19.128079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe763a8-36c3-4483-8767-a98f20a36c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:19.128711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe763a8-36c3-4483-8767-a98f20a36c93 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:19.128991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe763a8-36c3-4483-8767-a98f20a36c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:19.129263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe763a8-36c3-4483-8767-a98f20a36c93 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:19.129908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe763a8-36c3-4483-8767-a98f20a36c93 None admin] RBAC: Adding query filter params (type=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:19.130212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe763a8-36c3-4483-8767-a98f20a36c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:19.131627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe763a8-36c3-4483-8767-a98f20a36c93 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:19.139552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 389/778] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:19.145710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:19.206253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f56fc-eacf-4084-b940-e9ae52d79aa0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:19.206615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f56fc-eacf-4084-b940-e9ae52d79aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:19.206835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f56fc-eacf-4084-b940-e9ae52d79aa0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:19.208412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 390/779] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:19.213391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a30061-4506-4cbe-9e3a-f4f4f8d06533 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:19.213684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a30061-4506-4cbe-9e3a-f4f4f8d06533 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:19.213963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a30061-4506-4cbe-9e3a-f4f4f8d06533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:19.233107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-54a30061-4506-4cbe-9e3a-f4f4f8d06533 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:19.238379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-54a30061-4506-4cbe-9e3a-f4f4f8d06533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:19.301883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3100b-ffe8-4958-9711-a9b9363edcba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:19.344622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 391/780] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:19.369805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:19.370499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:19.370869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:19.371149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:19.371857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] RBAC: Adding query filter params (interface=public, service_id=e1b3da1b306b4a68b6cbe02193a00b37, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:19.372162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:19.373546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:19.382726 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 390/781] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:23:19 2022] GET /identity/v3/endpoints?service_id=e1b3da1b306b4a68b6cbe02193a00b37&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:19.388151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a30061-4506-4cbe-9e3a-f4f4f8d06533 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:19.502138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a30061-4506-4cbe-9e3a-f4f4f8d06533 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:19.503674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:19.539881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:19.540491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:19.540771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:19.541047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:19.541653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:19.543052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:19.548900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 392/782] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:19 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:19.841255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:19.844395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:19.962472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0133-ef6d-47eb-99fb-9b54646f190d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:20.009360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ec475-4f32-49ec-8be9-70b83df7654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:20.010490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec475-4f32-49ec-8be9-70b83df7654e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.010993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec475-4f32-49ec-8be9-70b83df7654e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.011524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec475-4f32-49ec-8be9-70b83df7654e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.029256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ec475-4f32-49ec-8be9-70b83df7654e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c08ec475-4f32-49ec-8be9-70b83df7654e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:20.035777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:20.036683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:20.037528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:20.039826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 391/783] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:20.045937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:20.084465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e92-6bd3-4e7b-8c14-8180865aca6c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.084810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e92-6bd3-4e7b-8c14-8180865aca6c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.085017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e92-6bd3-4e7b-8c14-8180865aca6c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.086650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 392/784] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:20.100430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fc076-d10c-4c7a-9283-d8f27fa3e3a5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.100684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fc076-d10c-4c7a-9283-d8f27fa3e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.100917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fc076-d10c-4c7a-9283-d8f27fa3e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.139667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-088fc076-d10c-4c7a-9283-d8f27fa3e3a5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:20.140926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-088fc076-d10c-4c7a-9283-d8f27fa3e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:20.159567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ff0c-13af-4121-b3ba-5d2c10aed8d0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:20.200102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:20.201510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.202398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.204557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.205461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:20.206162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:20.208602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:20.223086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 393/785] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:20.230827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:20.232418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:20.243176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 393/786] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:20.310709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:20.387515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234eb2-25e5-4fa3-897d-cdbd10b7542d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:20.422612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:20.423689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.423973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.424253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.435426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:20.436939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:20.451334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:20.452256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:20.453713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:20.453713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:20.453713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:20.453713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 394/787] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:20.458686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fc076-d10c-4c7a-9283-d8f27fa3e3a5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:20.603961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fc076-d10c-4c7a-9283-d8f27fa3e3a5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:20.661007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:20.661710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.661998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.662263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.662936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:20.663237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:20.664691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:20.665692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:20.684473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 394/788] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:20.691151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:20.790691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:20.796616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:20.833033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acc34f-af1c-4c24-9684-5e09b2b72dad None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:20.883179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd85724-f012-47ff-a9b0-b68448fb3cba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:20.904744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:20.905387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.906203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.906615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.930225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:20.941167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:20.942103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:20.942970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 395/789] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:20.950662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:20.956107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:20.956760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:20.957039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:20.957312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:20.971416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:20.972897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:20.996464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:20.997931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:20.998897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:21.006473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 395/790] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:21.011353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.106755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230db0-42a2-4c29-840d-1dd373ff8778 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:21.149450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:21.150279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.150716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.151672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.152840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:21.153259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:21.154870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:21.167116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 396/791] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:21.177717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.180719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:21.234695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1ca6e-c879-4fdd-91e6-30cad7f3cbc9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:21.270839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:21.301090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e24d9-5561-403f-a82f-d7031268e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:21.301709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e24d9-5561-403f-a82f-d7031268e441 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.301988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e24d9-5561-403f-a82f-d7031268e441 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.302260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e24d9-5561-403f-a82f-d7031268e441 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.303051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e24d9-5561-403f-a82f-d7031268e441 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:21.303355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e24d9-5561-403f-a82f-d7031268e441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:21.305309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e24d9-5561-403f-a82f-d7031268e441 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:21.329637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 396/792] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:21.332418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45df7-949b-4441-a800-15520be91848 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.332925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45df7-949b-4441-a800-15520be91848 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.333403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45df7-949b-4441-a800-15520be91848 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.334929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1161b-d07a-4202-96c0-9087535997e1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:21.339764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 397/793] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:21.340904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45df7-949b-4441-a800-15520be91848 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.379638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2596c-edaf-4e4d-9d6e-20361327e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:21.380290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2596c-edaf-4e4d-9d6e-20361327e123 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.380568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2596c-edaf-4e4d-9d6e-20361327e123 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.380898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2596c-edaf-4e4d-9d6e-20361327e123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.392457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2596c-edaf-4e4d-9d6e-20361327e123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:21.393906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2596c-edaf-4e4d-9d6e-20361327e123 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d8d2596c-edaf-4e4d-9d6e-20361327e123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:21.408354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:21.409335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:21.410206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:21.410206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:21.410206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:21.410206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 397/794] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:21.415436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5f7d-a7b0-4caf-8b08-d873c38b8d65 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.415726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5f7d-a7b0-4caf-8b08-d873c38b8d65 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.416003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5f7d-a7b0-4caf-8b08-d873c38b8d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.435553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-db5f5f7d-a7b0-4caf-8b08-d873c38b8d65 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:21.436663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-db5f5f7d-a7b0-4caf-8b08-d873c38b8d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:21.468810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45df7-949b-4441-a800-15520be91848 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:21.489150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:21.505808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481fde-3f26-430c-bc89-ff1a7d5139e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:21.506473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481fde-3f26-430c-bc89-ff1a7d5139e5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.506760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481fde-3f26-430c-bc89-ff1a7d5139e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.507039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481fde-3f26-430c-bc89-ff1a7d5139e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.518517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 398/795] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:21.518517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5f7d-a7b0-4caf-8b08-d873c38b8d65 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.527477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481fde-3f26-430c-bc89-ff1a7d5139e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:21.529142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481fde-3f26-430c-bc89-ff1a7d5139e5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8d481fde-3f26-430c-bc89-ff1a7d5139e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:21.545643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:21.546655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:21.547523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:21.547523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:21.547523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:21.547523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 398/796] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:21.548141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdce85-24d7-4ce6-b638-a41f2b06995e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.548431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdce85-24d7-4ce6-b638-a41f2b06995e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.550379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdce85-24d7-4ce6-b638-a41f2b06995e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.550379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 399/797] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:21.552544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdce85-24d7-4ce6-b638-a41f2b06995e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.584461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:21.654492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5f7d-a7b0-4caf-8b08-d873c38b8d65 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:21.688458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdce85-24d7-4ce6-b638-a41f2b06995e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:21.701292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2ab0-ccfa-4b90-836a-1d7588aec04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:21.702171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ab0-ccfa-4b90-836a-1d7588aec04c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.703500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ab0-ccfa-4b90-836a-1d7588aec04c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.703788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ab0-ccfa-4b90-836a-1d7588aec04c None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.704721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2ab0-ccfa-4b90-836a-1d7588aec04c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:21.705035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2ab0-ccfa-4b90-836a-1d7588aec04c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:21.707102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2ab0-ccfa-4b90-836a-1d7588aec04c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:21.722849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 399/798] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:21.724455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1842-407a-45f1-a66d-5de2c08ee7d8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.724749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1842-407a-45f1-a66d-5de2c08ee7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.725031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1842-407a-45f1-a66d-5de2c08ee7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.725134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:21.725809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.726159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.726546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.727302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:21.727669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:21.729216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:21.745702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-74ac1842-407a-45f1-a66d-5de2c08ee7d8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:21.746694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 400/799] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:21.746929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-74ac1842-407a-45f1-a66d-5de2c08ee7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:21.747792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.801860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:21.834074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 400/800] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:21.835285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1842-407a-45f1-a66d-5de2c08ee7d8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.846244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:21.866805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945b1f2-6933-4f9a-be85-e18834b6c033 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:21.908571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:21.909194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:21.909469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:21.909795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:21.917841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:21.919449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:21.933127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:21.934131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:21.935558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:21.938782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 401/801] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:21.939624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:21.967125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1842-407a-45f1-a66d-5de2c08ee7d8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.016476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4837184-ec18-4652-b240-684087c969be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.017776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4837184-ec18-4652-b240-684087c969be None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.018063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4837184-ec18-4652-b240-684087c969be None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.018364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4837184-ec18-4652-b240-684087c969be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.027742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4837184-ec18-4652-b240-684087c969be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.029733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4837184-ec18-4652-b240-684087c969be None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d4837184-ec18-4652-b240-684087c969be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:22.046669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:22.048756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 401/802] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:22.050899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4837184-ec18-4652-b240-684087c969be None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.057667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4bb8-674d-43d7-8426-3aaf2d5d80c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.096585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.097287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.097561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.097876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.098452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.098699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.100164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:22.111254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:22.113588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 04:23:22.115608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:22.117341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 402/803] 10.222.0.52 () {56 vars in 1129 bytes} [Sun Sep 25 04:23:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:22.122704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.128818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.176864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4837184-ec18-4652-b240-684087c969be None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.212687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.213217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.213492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.213763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.214516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:22.214818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.216235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.233077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 402/804] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:22.234587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.235386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503faaee-d8a9-4024-9e40-0dd37dd9418c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.272559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.273289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.273792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.274340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.275575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:22.275881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.277340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.291585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 403/805] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:22.292432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.329312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.338513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e416a1-a6b8-4b6b-be57-d7eaf14de8c6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.357283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.396832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e13d1-c28d-4d6e-87ef-1b0ffd149864 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.433368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ca7a2-1b0a-449e-960f-3f73697b8f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.434021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca7a2-1b0a-449e-960f-3f73697b8f6c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.434303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca7a2-1b0a-449e-960f-3f73697b8f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.434607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca7a2-1b0a-449e-960f-3f73697b8f6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.446108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ca7a2-1b0a-449e-960f-3f73697b8f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-032ca7a2-1b0a-449e-960f-3f73697b8f6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:22.451018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:22.452108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 404/806] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:22.455237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5584c1-f4d3-4c05-8ff4-8b61fabd211e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.455986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5584c1-f4d3-4c05-8ff4-8b61fabd211e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.455986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5584c1-f4d3-4c05-8ff4-8b61fabd211e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.455986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 405/807] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:22.456169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5584c1-f4d3-4c05-8ff4-8b61fabd211e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.492573 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.493094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.493366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.493633 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.494256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:22.494581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.495923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.500266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 403/808] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:22.501008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.563217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5584c1-f4d3-4c05-8ff4-8b61fabd211e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.589377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.600137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dec45-e8b6-4700-8b10-7b064c824ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.600745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dec45-e8b6-4700-8b10-7b064c824ede None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.601023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dec45-e8b6-4700-8b10-7b064c824ede None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.601155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366692c-16de-491e-a9ed-a9954cd974ea None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.601294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dec45-e8b6-4700-8b10-7b064c824ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.638727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.639386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.639665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.639939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/12819d6a0c19462d82b285502d0e27b0/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.641858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=12819d6a0c19462d82b285502d0e27b0, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.643300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.656542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 404/809] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:23:22 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/12819d6a0c19462d82b285502d0e27b0/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:23:22.657352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.677795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.686976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dec45-e8b6-4700-8b10-7b064c824ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.688601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dec45-e8b6-4700-8b10-7b064c824ede None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.777462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a77fa-697e-43a0-82a9-a93182d546bb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:22.808370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 406/810] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:23:22.808370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e459-1542-4000-9551-97572405b122 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.808370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e459-1542-4000-9551-97572405b122 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.808370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e459-1542-4000-9551-97572405b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.820080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:22.820702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:22.821004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:22.821357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:22.822018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:22.822323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:22.823735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:22.826315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b0b4e459-1542-4000-9551-97572405b122 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:22.828126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b0b4e459-1542-4000-9551-97572405b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:22.839762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 405/811] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:22.840601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.851490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.899312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 407/812] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:22.900314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4e459-1542-4000-9551-97572405b122 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:22.936081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:22.964514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ebac-d363-480e-b2cf-ee59c2e05ae3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.002644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.003254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.003533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.003810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.004442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:23.005056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.006209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.016825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 406/813] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:23.016825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.034478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4e459-1542-4000-9551-97572405b122 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.074452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.075413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.075874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.076420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.087615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.089449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:23.107321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:23.108268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:23.109229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:23.109229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:23.109229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:23.111622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 408/814] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:23.112662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.120381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a09c5-4849-4759-b4bc-f885d2efa4cf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.125134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:23.158258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.159259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.159729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.160212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.170961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.172734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.174991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:23.189695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:23.191076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:23.192199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:23.192199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:23.192199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:23.192199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 407/815] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:23.192199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.227412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8a44d-db55-4244-ad1c-f22bc763a89b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.269145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.269762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.270100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.270749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.271428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.273132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.294373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281ede8-89e6-4db5-8690-c905ffa2f433 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.307110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 409/816] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:23.307110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.360683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.361695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.361977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.362535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.363208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:23.363516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.364945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:23.365690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.382986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 408/817] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:23.384410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.415125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28e9bf-128e-4ddf-b265-17c6d1e65e52 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.455628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.456543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.456957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.457358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] PATH_INFO: `/v3/services/network` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.458476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.458743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:23.459905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:23.470434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:23.471539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:23.477286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 410/818] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:23.478081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.522240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de058-5700-404e-97ff-1d2975478e14 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.565138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.565482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.565728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.566000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.567248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:23.567248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.568356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.581556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 409/819] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:23.582891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.610114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387f9d0-08e8-46e8-b110-e0348dc4a41d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.647423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:23.661004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.661645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.661929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.662223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.673447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.674959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:23.687455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:23.688421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 411/820] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:23.689665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.714128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff219-6637-41e3-a13e-8456118bbdad None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.729400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:23.763350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.764241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.764686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.765368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.766627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:23.766950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.768328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.781374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 410/821] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:23.781374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.811022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756400d1-f789-40c0-8962-06b3874925cf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.851422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.852406 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.853310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.853763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.862876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.864586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:23.877318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:23.878265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:23.879202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:23.880958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 412/822] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:23.881989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:23.905141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04154aa-b0d3-4123-900e-e55ea72c81c2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:23.946523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:23.947643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:23.948069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:23.948485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:23.948686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:23.950029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:23.950874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:23.952739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:23.969069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 411/823] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:23.970680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:24.011619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cd5b1-2180-40eb-819b-ccbd68aa302c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:24.011941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:24.055345 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:24.055951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.056390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.056732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.057753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:24.058140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:24.060731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:24.070435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 413/824] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:24.070435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:24.096786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5b97-c9c4-4c21-a49b-2bb34f3569eb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:24.132703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:24.133496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.133916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.134306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.135332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:24.135809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:24.137249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:24.155931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 412/825] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Sep 25 04:23:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:24.158145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:24.201441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520b79-d95c-4da5-bfb8-43a2cf5f49c8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:24.219109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:24.248689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:24.249821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.250246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.250941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.252279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=079636b6d56943928420801c47555aea) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:24.252749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:24.254638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:24.261572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 414/826] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:24 2022] GET /identity/v3/role_assignments?user.id=079636b6d56943928420801c47555aea&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:24.262636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:24.275909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:24.288446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecad8a6-be2d-4eb3-a75d-384a54339d3e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:24.392636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456109-492b-45e2-b24f-ac4375631809 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:24.419800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:24.420434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.420715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.421021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.421734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:24.423093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:24.431902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:24.432909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.433389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.433854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.447299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:24.449162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:24.466741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:24.467728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:24.469208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:24.469208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:24.469208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:24.471901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 415/827] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:24.478517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:24.488758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 413/828] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:24.521310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:24.597205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffe18-47b2-4658-ab59-0c65b46c83ab None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:24.647117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:24.648110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.648587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.649068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.649921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:24.650460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:24.652135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:24.667443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 416/829] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:24.673777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:24.781455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794ee4-81cf-44e1-91f0-e233e4c8291f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:24.822922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0ef96-17f2-4090-9ce1-c8f069f32b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:24.823975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ef96-17f2-4090-9ce1-c8f069f32b87 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.824452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ef96-17f2-4090-9ce1-c8f069f32b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.824920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ef96-17f2-4090-9ce1-c8f069f32b87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.836113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0ef96-17f2-4090-9ce1-c8f069f32b87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:24.837921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0ef96-17f2-4090-9ce1-c8f069f32b87 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-c3f0ef96-17f2-4090-9ce1-c8f069f32b87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:24.851279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:24.852252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:24.853125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:24.855479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 414/830] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:24.862940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:24.937806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ceb2-d4ff-432d-9cba-a7a0041ac079 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.937987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ceb2-d4ff-432d-9cba-a7a0041ac079 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.938271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ceb2-d4ff-432d-9cba-a7a0041ac079 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.939873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 415/831] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:24.945867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c1bf-67c8-4723-8ad2-11320672d12d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:24.946173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c1bf-67c8-4723-8ad2-11320672d12d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:24.946448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c1bf-67c8-4723-8ad2-11320672d12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:24.978468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b0e7c1bf-67c8-4723-8ad2-11320672d12d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:24.979753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b0e7c1bf-67c8-4723-8ad2-11320672d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:24.989129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:25.058722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 416/832] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:25.076490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:25.093824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cc9a0-279a-4092-86ba-e12361470008 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:25.127841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:25.128448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:25.128731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:25.129003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:25.129691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:25.129994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:25.131542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:25.144200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 417/833] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:25.149809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c1bf-67c8-4723-8ad2-11320672d12d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:25.251766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c1bf-67c8-4723-8ad2-11320672d12d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:25.297214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:25.297949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:25.298132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:25.298430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/7edd6fd40289457d94e4ae4b7a26be80/roles/ffccef46ca484651b96df0b7a6254ff4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:25.306576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:25.315440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=7edd6fd40289457d94e4ae4b7a26be80, role_id=ffccef46ca484651b96df0b7a6254ff4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:25.316889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:25.334465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 417/834] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:23:25 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/7edd6fd40289457d94e4ae4b7a26be80/roles/ffccef46ca484651b96df0b7a6254ff4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:23:25.336560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:25.456922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e30ef-7dff-44ee-bee9-a426fef50eef None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:25.495719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb4c6c-5b4f-4f6f-ab80-c5e26893ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:25.496367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4c6c-5b4f-4f6f-ab80-c5e26893ae7a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:25.496647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4c6c-5b4f-4f6f-ab80-c5e26893ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:25.496921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4c6c-5b4f-4f6f-ab80-c5e26893ae7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:25.508886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb4c6c-5b4f-4f6f-ab80-c5e26893ae7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0bcb4c6c-5b4f-4f6f-ab80-c5e26893ae7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:25.513683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:25.514586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:25.516152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 418/835] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:25.523455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:25.637978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552165-f3c3-4f6a-840f-9a09ad314db2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:25.660827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544fc2f-bad6-49ba-bdfb-cf14d46940d3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:25.661149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544fc2f-bad6-49ba-bdfb-cf14d46940d3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:25.661385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544fc2f-bad6-49ba-bdfb-cf14d46940d3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:25.663043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 419/836] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:25.668385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce0694-3891-48ae-b9e5-683ba22ecbdf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:25.668674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce0694-3891-48ae-b9e5-683ba22ecbdf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:25.668951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce0694-3891-48ae-b9e5-683ba22ecbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:25.676598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:25.678386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:25.679276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:25.679556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:25.680008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:25.680786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:25.681093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:25.683510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:25.688629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-afce0694-3891-48ae-b9e5-683ba22ecbdf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:25.689844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-afce0694-3891-48ae-b9e5-683ba22ecbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:25.693243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 418/837] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:25.699366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:25.755114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:25.759418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 420/838] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:25.808041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc5bf-f3c9-4f28-aa1a-833b46f4c53f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:25.842665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:25.843409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:25.843687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:25.843960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:25.854684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:25.856126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:25.871123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:25.872061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:25.872917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:25.872917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:25.872917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:25.872917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 419/839] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:25.878170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce0694-3891-48ae-b9e5-683ba22ecbdf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:25.982683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce0694-3891-48ae-b9e5-683ba22ecbdf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.019413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.019948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.020227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.020503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.021150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:26.021518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.022948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.024467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:26.036609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 421/840] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:26.041110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:26.043933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:26.149031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081a6e-7ed9-4619-a542-4a5369bfb3fc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.160521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687933b8-4392-499a-85ac-843a1898dfbb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.162744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:26.196433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.197409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.197905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.198421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.207056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.208111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.208973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.209166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.209658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.210266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.210884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.213096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:26.222137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:26.223178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 04:23:26.224079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:26.224588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:26.225437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:26.226264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 420/841] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:26.232899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 422/842] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:26.233041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:26.235320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:26.297220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:26.352714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329572-3870-4ecf-a218-0193dd04fba7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.366084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30891bae-21ae-40af-900a-b6c03e4dc704 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.390638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.391381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.391759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.392130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.393063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:26.393466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.395034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.409921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.410730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.411115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.411482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.412213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:26.413171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.415011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.416982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 423/843] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Sep 25 04:23:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:26.421589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 421/844] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:26.422674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:26.431772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:26.470280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:26.541489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74d6e-45ba-4996-ba78-5470569c05c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.558473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60117-8ff2-44c3-9173-06f25daaf870 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.558625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:26.586295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceed42d-0d0e-414b-816c-5fa12a008053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.587215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed42d-0d0e-414b-816c-5fa12a008053 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.587501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed42d-0d0e-414b-816c-5fa12a008053 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.587776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed42d-0d0e-414b-816c-5fa12a008053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.603060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.604148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.604637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.605299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.606584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:26.607393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.609957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.622904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 422/845] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:26.669651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceed42d-0d0e-414b-816c-5fa12a008053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.671685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceed42d-0d0e-414b-816c-5fa12a008053 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.791698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 424/846] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:23:26.797999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:26.875299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475239-3496-49a1-8c51-e9cbc9305997 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.875916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475239-3496-49a1-8c51-e9cbc9305997 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.876420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475239-3496-49a1-8c51-e9cbc9305997 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.878308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 425/847] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:26.885685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017db3ae-b8d9-4fcf-98d3-816d828cd5d5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.885973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017db3ae-b8d9-4fcf-98d3-816d828cd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.886249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017db3ae-b8d9-4fcf-98d3-816d828cd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.902889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:26.905138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-017db3ae-b8d9-4fcf-98d3-816d828cd5d5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:26.907482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-017db3ae-b8d9-4fcf-98d3-816d828cd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:26.912682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a9b68-47d0-48d4-8e21-d3cca18d6626 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:26.916334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:26.960165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:26.961193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:26.961677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:26.962147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:26.976201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:26.978383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:26.996140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:26.997114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:26.997989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:26.997989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:26.997989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:26.998594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 426/848] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:27.000736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 423/849] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:27.006408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017db3ae-b8d9-4fcf-98d3-816d828cd5d5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:27.107714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017db3ae-b8d9-4fcf-98d3-816d828cd5d5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:27.143729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:27.144662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.145145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.145692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.146565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:27.147068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:27.148628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:27.161159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 427/850] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:27.171437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:27.279181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3debe81-8dd6-489a-b036-5f06cfcc1650 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:27.299744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:27.302634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:27.323049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:27.323683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.323957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.324227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.335863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:27.338129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:27.352884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:27.353811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:27.354737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:27.357309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 424/851] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:27.364387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:27.375135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:27.422546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97346-42eb-4eae-8e24-c1bca2b4aca4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:27.459340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:27.459983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.460261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.460534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.461117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:27.462580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:27.472269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:27.473195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:27.474083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:27.478451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 428/852] 10.222.0.52 () {56 vars in 1132 bytes} [Sun Sep 25 04:23:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:27.479307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:27.479787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607619d-e371-469d-b5f0-03e75a89d9d7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:27.517664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:27.518838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.519349 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.519850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.520790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:27.521317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:27.523051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:27.543042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 425/853] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:27.544848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:27.558754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:27.603322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b7508-5e34-4d32-a664-9df0383a9be9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:27.621271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:27.648656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034960b7-57bb-4b10-8567-feb7f3aeeab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:27.649316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034960b7-57bb-4b10-8567-feb7f3aeeab4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.649532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034960b7-57bb-4b10-8567-feb7f3aeeab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.649800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034960b7-57bb-4b10-8567-feb7f3aeeab4 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.650464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034960b7-57bb-4b10-8567-feb7f3aeeab4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:27.650763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034960b7-57bb-4b10-8567-feb7f3aeeab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:27.652120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034960b7-57bb-4b10-8567-feb7f3aeeab4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:27.661439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 429/854] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:27.661439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628daccc-3c3f-4c62-9472-8ac55f72f42f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.661439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628daccc-3c3f-4c62-9472-8ac55f72f42f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.661439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628daccc-3c3f-4c62-9472-8ac55f72f42f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.661439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 430/855] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:27.662409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628daccc-3c3f-4c62-9472-8ac55f72f42f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:27.665880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7b6e4-1f95-4639-8613-eefb8800c92b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:27.701659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f4c06-f089-4fa5-b476-8f2e4319b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:27.702400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f4c06-f089-4fa5-b476-8f2e4319b353 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.702574 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f4c06-f089-4fa5-b476-8f2e4319b353 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.702825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f4c06-f089-4fa5-b476-8f2e4319b353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.703546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f4c06-f089-4fa5-b476-8f2e4319b353 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=12819d6a0c19462d82b285502d0e27b0) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:27.703851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f4c06-f089-4fa5-b476-8f2e4319b353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:27.705325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f4c06-f089-4fa5-b476-8f2e4319b353 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:27.717328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 426/856] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:27 2022] GET /identity/v3/role_assignments?user.id=12819d6a0c19462d82b285502d0e27b0&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:27.717328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce6dfd-a79d-4608-93b8-76a839babe33 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.717328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce6dfd-a79d-4608-93b8-76a839babe33 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.717328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce6dfd-a79d-4608-93b8-76a839babe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.735923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-44ce6dfd-a79d-4608-93b8-76a839babe33 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:27.737275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-44ce6dfd-a79d-4608-93b8-76a839babe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:27.785830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628daccc-3c3f-4c62-9472-8ac55f72f42f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:27.820725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:27.822936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 427/857] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:27.835363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:27.835363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:27.835363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:27.835363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:27.835809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:27.835809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:27.836054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:27.842018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 431/858] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:28.097866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce6dfd-a79d-4608-93b8-76a839babe33 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:28.158485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:28.199453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce6dfd-a79d-4608-93b8-76a839babe33 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:28.235252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:28.235891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:28.236171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:28.236448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:28.247115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:28.252080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:28.252986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:23:28.253796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:28.258069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 428/859] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:23:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:28.263895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:28.371473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5719-f724-4691-9e0c-464e64c2e242 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:28.408066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:28.409060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:28.409547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:28.410019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:28.410945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:28.411449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:28.413043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:28.422688 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 432/860] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:23:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:28.431912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:28.537062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed665c-bb32-47c4-844b-6a710988b175 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:28.557607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:28.576066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:28.577078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:28.578109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:28.578619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:28.590240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:28.592069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:28.607315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:28.608251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:28.609174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:28.609174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:28.609174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:28.611264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 429/861] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:28.619675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:28.677981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:28.726499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ee16-4fee-4464-9c90-f297c3f30030 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:28.765203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63657aee-a5fe-4f48-b92b-88abe859e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:28.765840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63657aee-a5fe-4f48-b92b-88abe859e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:28.766129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63657aee-a5fe-4f48-b92b-88abe859e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:28.766445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63657aee-a5fe-4f48-b92b-88abe859e1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:28.767096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63657aee-a5fe-4f48-b92b-88abe859e1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:28.767403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63657aee-a5fe-4f48-b92b-88abe859e1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:28.768882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63657aee-a5fe-4f48-b92b-88abe859e1e6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:28.782109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 433/862] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:28.787694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:28.862987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8902-62b4-468d-b433-c4a929f0b26b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:28.863313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8902-62b4-468d-b433-c4a929f0b26b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:28.863818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8902-62b4-468d-b433-c4a929f0b26b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:28.865678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 434/863] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:28.870881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2e18-f183-426a-83c7-bb344b80549e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:28.871225 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2e18-f183-426a-83c7-bb344b80549e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:28.871507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2e18-f183-426a-83c7-bb344b80549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:28.890998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2ace2e18-f183-426a-83c7-bb344b80549e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:28.892327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ace2e18-f183-426a-83c7-bb344b80549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:28.898803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c38f9-9a97-4bd7-835a-202d44ca2713 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:28.933574 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:28.934129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:28.934583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:28.934889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:28.943392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:28.944844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:28.956635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:28.957541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:28.958843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 430/864] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:23:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:28.963475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:28.965866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 435/865] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:28.995611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:29.068477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c27f-8b4a-45c7-87d1-46232f27c7db None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:29.102663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:29.103266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:29.103542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:29.103816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:29.104539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:29.104838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:29.106260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:29.123841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 431/866] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Sep 25 04:23:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:29.129649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace2e18-f183-426a-83c7-bb344b80549e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:29.175834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:29.229719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace2e18-f183-426a-83c7-bb344b80549e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:29.267397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:29.268007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:29.268281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:29.268549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:29.269737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:29.348318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:29.349886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:29.372256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:29.383181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4e39-5edc-4021-b039-296a23431173 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:29.397647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:29.421276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:29.421944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:29.422322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:29.422646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:29.423313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:29.424674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:29.442088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 432/867] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:29 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:23:29.470062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 436/868] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:23:29.475669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:29.597136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28517ccb-ee9c-4e9d-b916-c0b67f9ca917 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:29.634667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:29.635318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:29.635600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:29.635879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:29.647650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:29.649112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:29.656366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:29.665484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:29.666469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:29.667923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:29.667923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:29.667923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:29.667923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 433/869] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:29.674333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:29.777971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057524-2e7c-4831-8f45-3d1f7439033a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:29.817415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e22f-fdd1-4839-bfb7-03cac9118817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:29.818034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e22f-fdd1-4839-bfb7-03cac9118817 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:29.818316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e22f-fdd1-4839-bfb7-03cac9118817 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:29.818635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e22f-fdd1-4839-bfb7-03cac9118817 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:29.819286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e22f-fdd1-4839-bfb7-03cac9118817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:29.819591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e22f-fdd1-4839-bfb7-03cac9118817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:29.820968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e22f-fdd1-4839-bfb7-03cac9118817 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:29.833004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 437/870] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:29.838645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:29.954417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2e02d-a14f-4e04-b75e-91a07f09c203 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:29.990083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:29.990756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:29.991037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:29.991373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:29.998681 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:29.999695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eff69-dc74-4463-bbc1-5661bc85f806 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.000182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eff69-dc74-4463-bbc1-5661bc85f806 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.000651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eff69-dc74-4463-bbc1-5661bc85f806 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.000767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:30.003660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 438/871] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:30.008092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f19ed6-cbc8-4823-8d1a-f651ae3b3761 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.008621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f19ed6-cbc8-4823-8d1a-f651ae3b3761 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.009094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f19ed6-cbc8-4823-8d1a-f651ae3b3761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:30.013086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:30.013954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:30.015003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:30.018587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 434/872] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:30.020110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:30.031457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-61f19ed6-cbc8-4823-8d1a-f651ae3b3761 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:30.033001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-61f19ed6-cbc8-4823-8d1a-f651ae3b3761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:30.058714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:30.086460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:30.125784 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 439/873] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:30.137445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262b3f1-11be-40d9-8e1d-4576b75f7297 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:30.171980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521329f3-9a88-459c-8373-a0acd5495748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:30.172593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521329f3-9a88-459c-8373-a0acd5495748 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.172875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521329f3-9a88-459c-8373-a0acd5495748 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.173209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521329f3-9a88-459c-8373-a0acd5495748 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.173915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521329f3-9a88-459c-8373-a0acd5495748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:30.174220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521329f3-9a88-459c-8373-a0acd5495748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:30.175686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521329f3-9a88-459c-8373-a0acd5495748 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:30.188733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 435/874] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:30.194722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f19ed6-cbc8-4823-8d1a-f651ae3b3761 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:30.207669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4addd-cd72-4c82-95d1-ecf1af27c02a None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.208204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4addd-cd72-4c82-95d1-ecf1af27c02a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.208484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4addd-cd72-4c82-95d1-ecf1af27c02a None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.210371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 436/875] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:30.216005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0fe00-b784-40fe-8962-d232861910d4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.216284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0fe00-b784-40fe-8962-d232861910d4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.216831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0fe00-b784-40fe-8962-d232861910d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.241462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c7e0fe00-b784-40fe-8962-d232861910d4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:30.242711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c7e0fe00-b784-40fe-8962-d232861910d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:30.312529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f19ed6-cbc8-4823-8d1a-f651ae3b3761 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:30.334380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 437/876] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:30.361424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:30.362226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.362723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.363175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.364095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=7edd6fd40289457d94e4ae4b7a26be80) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:30.364579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:30.366197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:30.369261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:30.373689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 440/877] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:30 2022] GET /identity/v3/role_assignments?user.id=7edd6fd40289457d94e4ae4b7a26be80&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:30.405610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0fe00-b784-40fe-8962-d232861910d4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:30.463045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:30.520036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0fe00-b784-40fe-8962-d232861910d4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:30.558919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:30.559129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.559355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.559632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.560507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:30.562440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:30.571577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:30.572538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:30.573513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 438/878] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:30.581447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:30.614086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:30.710258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398d50-167e-4f31-a85f-a97aa99dc96a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:30.739383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f3260-54fe-4694-90a5-6f458f0314ee None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:30.750557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:30.751281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.751569 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.751846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.752490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:30.752794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:30.753459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:30.755310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:30.761532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 441/879] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:30.766721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:30.779859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c61134-a40f-4f53-b469-4989acd2ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:30.780996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c61134-a40f-4f53-b469-4989acd2ea20 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.781287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c61134-a40f-4f53-b469-4989acd2ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.781543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c61134-a40f-4f53-b469-4989acd2ea20 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.782372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c61134-a40f-4f53-b469-4989acd2ea20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:30.783767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c61134-a40f-4f53-b469-4989acd2ea20 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:30.810379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 439/880] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:30 2022] POST /identity/v3/services => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:23:30.850740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:30.892331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d1b1-4595-4243-819b-1ab286c7b255 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:30.938808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911225-9832-4ba8-8e4e-5c9668d55e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:30.939448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911225-9832-4ba8-8e4e-5c9668d55e82 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:30.939728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911225-9832-4ba8-8e4e-5c9668d55e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:30.940003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911225-9832-4ba8-8e4e-5c9668d55e82 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:30.940650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911225-9832-4ba8-8e4e-5c9668d55e82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:30.940955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911225-9832-4ba8-8e4e-5c9668d55e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:30.942379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911225-9832-4ba8-8e4e-5c9668d55e82 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:30.948002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 442/881] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:31.754585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885ec5-f25e-4260-ad03-fffe9ce85824 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:31.755670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885ec5-f25e-4260-ad03-fffe9ce85824 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:31.756142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885ec5-f25e-4260-ad03-fffe9ce85824 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:31.758082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 440/882] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:31.764339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d86d7-8d26-470a-9ce7-9c47af7cf7c4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:31.765715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d86d7-8d26-470a-9ce7-9c47af7cf7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:31.766199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d86d7-8d26-470a-9ce7-9c47af7cf7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:31.785544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d80d86d7-8d26-470a-9ce7-9c47af7cf7c4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:31.786778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d80d86d7-8d26-470a-9ce7-9c47af7cf7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:31.860286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 443/883] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:32.141100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885ec5-f25e-4260-ad03-fffe9ce85824 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:32.244746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885ec5-f25e-4260-ad03-fffe9ce85824 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:32.282617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:32.283569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:32.284056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:32.284522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:32.285296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:32.286898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:32.296234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:32.297337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:32.298248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:32.300970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 441/884] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:32.307094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d86d7-8d26-470a-9ce7-9c47af7cf7c4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:32.365243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:32.411379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d86d7-8d26-470a-9ce7-9c47af7cf7c4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:32.450186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:32.450844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:32.451372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:32.451650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:32.452828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:32.453136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:32.454552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:32.459795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 444/885] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:32.466179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:32.503921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:32.569353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c22503-601d-4593-8cc8-75b5838fd130 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:32.603547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4948a-6555-4a81-99e1-1d0932761a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:32.604212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4948a-6555-4a81-99e1-1d0932761a23 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:32.604494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4948a-6555-4a81-99e1-1d0932761a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:32.604815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4948a-6555-4a81-99e1-1d0932761a23 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:32.605456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4948a-6555-4a81-99e1-1d0932761a23 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:32.605761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4948a-6555-4a81-99e1-1d0932761a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:32.607163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4948a-6555-4a81-99e1-1d0932761a23 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:32.612783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 442/886] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:32.618609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:32.728694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e796e55-b6c7-4d96-8ef5-45040ec871c7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:32.746913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:32.766080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:32.767042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:32.767567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:32.767952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:32.769109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] RBAC: Adding query filter params (interface=public, service_id=0a11b21204a74797973a093cd7e0ef1a, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:32.769542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:32.772039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:32.778245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 445/887] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:23:32 2022] GET /identity/v3/endpoints?service_id=0a11b21204a74797973a093cd7e0ef1a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:32.784410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ea71-4858-41d5-93b8-ed4bc62530e2 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:32.784865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ea71-4858-41d5-93b8-ed4bc62530e2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:32.784956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ea71-4858-41d5-93b8-ed4bc62530e2 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:32.785033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:32.786684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 443/888] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:32.791933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93e290-597f-42bf-bc60-32315372c6d6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:32.792222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93e290-597f-42bf-bc60-32315372c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:32.792499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93e290-597f-42bf-bc60-32315372c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:32.810786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9c93e290-597f-42bf-bc60-32315372c6d6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:32.812494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9c93e290-597f-42bf-bc60-32315372c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:32.892791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ccdac-9c24-4c75-b161-e3deb6c6d45d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:32.902694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 444/889] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:32.934724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221921-2d32-4cb5-8182-f0e165ef9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:32.935596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221921-2d32-4cb5-8182-f0e165ef9868 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:32.935875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221921-2d32-4cb5-8182-f0e165ef9868 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:32.936150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221921-2d32-4cb5-8182-f0e165ef9868 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:32.937289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221921-2d32-4cb5-8182-f0e165ef9868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:32.938808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221921-2d32-4cb5-8182-f0e165ef9868 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:32.945146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 446/890] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:32 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:23:33.121104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb7561-a164-4680-b5bd-c7766fe6d14c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.121104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb7561-a164-4680-b5bd-c7766fe6d14c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.121104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb7561-a164-4680-b5bd-c7766fe6d14c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.121104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 445/891] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:33.126772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f545205-efb4-4b68-8b64-ada992c034f4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.127063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f545205-efb4-4b68-8b64-ada992c034f4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.127340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f545205-efb4-4b68-8b64-ada992c034f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.146539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1f545205-efb4-4b68-8b64-ada992c034f4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:33.147751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1f545205-efb4-4b68-8b64-ada992c034f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:33.173803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb7561-a164-4680-b5bd-c7766fe6d14c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.198173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:33.212782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:33.235730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 447/892] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:33.294000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb7561-a164-4680-b5bd-c7766fe6d14c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:33.309451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d42dd-9649-4757-9b47-247bfed3d345 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.310332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d42dd-9649-4757-9b47-247bfed3d345 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.310857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d42dd-9649-4757-9b47-247bfed3d345 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.316369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 448/893] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:33.318026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e196a3b-e72c-4eb4-b2ec-424897832d7f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.318548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e196a3b-e72c-4eb4-b2ec-424897832d7f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.320277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e196a3b-e72c-4eb4-b2ec-424897832d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.330906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:33.331549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.331828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.332103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.341573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9e196a3b-e72c-4eb4-b2ec-424897832d7f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:33.342992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:33.343420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e196a3b-e72c-4eb4-b2ec-424897832d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:33.348227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:33.349151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:33.350434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 446/894] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Sep 25 04:23:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:33.355425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.424643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 449/895] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:33.450213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:33.461077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424353-cab8-4e36-abb8-e8f1363e38b1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:33.496437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:33.497042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.497322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.497599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.498265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:33.498599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:33.500185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:33.508853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 447/896] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Sep 25 04:23:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:33.515133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e196a3b-e72c-4eb4-b2ec-424897832d7f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.533880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.625805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e196a3b-e72c-4eb4-b2ec-424897832d7f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:33.634317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:33.636506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc6eaa-105f-4cf9-83e4-f88eb4ca873c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:33.666211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:33.667432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.667931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.668417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.672329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:33.673181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.673619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.674060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.675009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:33.676531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:33.680873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:33.682598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:33.687056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:33.688196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:33.689087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:33.695383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 448/897] 10.222.0.52 () {56 vars in 1132 bytes} [Sun Sep 25 04:23:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:33.695464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:33.705033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:33.705997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:33.706936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:33.706936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:33.706936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:33.707655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 450/898] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:33.708755 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.719554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:33.809760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e911b-5b0d-4466-b87d-e2f4bd2f4358 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:33.810673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952229c0-d065-48b9-90b7-02d6aac592b8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:33.846611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:33.846838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:33.847251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.847474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:33.847588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.847762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:33.847860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.848039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:33.848461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:33.848689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:33.848999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:33.849878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:33.850575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:33.856659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 449/899] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:33.857456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.882560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 451/900] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:33 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:33.883661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:33.917620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:33.969220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:33.995647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67ac4-308f-40f3-b4f2-43c2b8d9a473 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.022314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81ea4-3395-489c-90b3-f66240b0c1eb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.044148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.044779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.045070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.045351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.047833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:34.047833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:34.050010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:34.064055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 450/901] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:34.066074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.066731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.067016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.067302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.067945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:34.068255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:34.069716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:34.070760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:34.076712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 452/902] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:34.084430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:34.194226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:34.206411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1555-2427-4c5b-85e0-a379f6d16b54 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.226723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65061caf-bfff-4836-8bc3-685818b8bcbb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.250484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.251592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.252013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.252400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.262444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:34.264057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:34.266036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.266912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.267470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:34.267580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.268045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.268952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] RBAC: Adding query filter params (interface=public, service_id=6f88a114dc3444fc8a70adf2d0a2ddb2, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:34.269465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:34.271178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:34.277407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 453/903] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:23:34 2022] GET /identity/v3/endpoints?service_id=6f88a114dc3444fc8a70adf2d0a2ddb2&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:34.282857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:34.283466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:34.284420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:34.285712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 451/904] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:23:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:34.291769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:34.406487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43e928-91a6-4073-8d0c-26c91bf915e0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.419310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16086ad8-7964-45da-abd8-1e2cc77fdfea None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.447282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.448401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.448919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.449408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.450520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:34.451099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:34.453040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:34.459831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.460455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.460736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.461010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.461701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:34.463320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:34.478470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 454/905] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:34 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:23:34.482162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 452/906] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Sep 25 04:23:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:34.488574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:34.498857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:34.606224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334de74c-fabc-4a0b-9615-1ead9ad32c83 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.650485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.651496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.652006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.652480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.725769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:34.727626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:34.736329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:34.836960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 455/907] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:34 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:23:34.843912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:34.906603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:34.950879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b645d-f170-484e-b865-337e923b0b27 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:34.987604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277e192-6347-408b-b447-8820c899efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:34.988162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e192-6347-408b-b447-8820c899efc5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:34.988442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e192-6347-408b-b447-8820c899efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:34.988715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e192-6347-408b-b447-8820c899efc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:34.999787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277e192-6347-408b-b447-8820c899efc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:35.001236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277e192-6347-408b-b447-8820c899efc5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3277e192-6347-408b-b447-8820c899efc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:35.020313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:35.021276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:35.022802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:35.022802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:35.022802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:35.022802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 453/908] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:35.027036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:35.135043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6d3f-e222-48f4-8ae9-4fb54814a047 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:35.143162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:35.159894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9556-806d-4d95-b71b-3d441a0c8aec None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.160199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9556-806d-4d95-b71b-3d441a0c8aec None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.160438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9556-806d-4d95-b71b-3d441a0c8aec None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.162225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 454/909] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:35.167443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a2766-5ef7-4dbd-9335-6976b01ff3d3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.167733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a2766-5ef7-4dbd-9335-6976b01ff3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.168003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a2766-5ef7-4dbd-9335-6976b01ff3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.172722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:35.173382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.173671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.173946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.174916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:35.176089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:35.177490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:35.187699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-904a2766-5ef7-4dbd-9335-6976b01ff3d3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:35.188899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-904a2766-5ef7-4dbd-9335-6976b01ff3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:35.191153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 456/910] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:35.196473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:35.274472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 455/911] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:35.302826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b432a22-9780-46d3-bff6-c1a310c034d5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:35.338088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:35.338751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.339031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.339303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.346598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:35.348095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:35.359609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:35.360565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:35.361817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 457/912] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:35.366731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a2766-5ef7-4dbd-9335-6976b01ff3d3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:35.409782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:35.473068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a2766-5ef7-4dbd-9335-6976b01ff3d3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:35.506959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:35.507561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.507836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.508106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.508793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:35.509097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:35.510593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:35.522611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 456/913] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:35.528316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:35.563043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:35.568356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:35.647835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968178f6-4ca9-41c9-a0da-5a22c5ad63a5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:35.680680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:35.683857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713c79-d926-4732-b625-6d57591de1f0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:35.684060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:35.684565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.685260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.685629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.686746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] RBAC: Adding query filter params (role.id=9e75c2c3089d4100bc098bf0beb85827, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=7edd6fd40289457d94e4ae4b7a26be80) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:35.687058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:35.688497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:35.694585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 458/914] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:35 2022] GET /identity/v3/role_assignments?user.id=7edd6fd40289457d94e4ae4b7a26be80&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=9e75c2c3089d4100bc098bf0beb85827 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:35.722951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:35.723611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.723889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.724164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.724760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:35.726165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:35.736757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:35.739320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:35.741298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 457/915] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:35.744321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:35.849513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:35.862005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82822a-a50d-406f-99ff-0f13a9d30a32 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:35.901775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:35.902423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:35.902711 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:35.902986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:35.903620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:35.903925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:35.905825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:35.911054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 459/916] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:35.916492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:36.022048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1732fb-92f3-4370-8017-65692d9aa684 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:36.057692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f820587-4b66-4fa3-843e-76bae2283623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:36.058716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820587-4b66-4fa3-843e-76bae2283623 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.059219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820587-4b66-4fa3-843e-76bae2283623 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.059714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820587-4b66-4fa3-843e-76bae2283623 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.060810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f820587-4b66-4fa3-843e-76bae2283623 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:36.061897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f820587-4b66-4fa3-843e-76bae2283623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:36.063506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f820587-4b66-4fa3-843e-76bae2283623 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:36.069130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 458/917] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Sep 25 04:23:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:36.074970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:36.188628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eaf21-eded-4790-94f2-fc75313fe0be None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:36.201378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8575e-b291-458e-ae17-9e86b944afb5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.201663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8575e-b291-458e-ae17-9e86b944afb5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.202507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8575e-b291-458e-ae17-9e86b944afb5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.203966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 459/918] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:36.209145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870cbe-2e80-4bc3-a4a6-cb3cc4015c40 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.209672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870cbe-2e80-4bc3-a4a6-cb3cc4015c40 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.210163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870cbe-2e80-4bc3-a4a6-cb3cc4015c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.229154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a3870cbe-2e80-4bc3-a4a6-cb3cc4015c40 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:36.229830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:36.230477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.230760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.231037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.231617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a3870cbe-2e80-4bc3-a4a6-cb3cc4015c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:36.231733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:36.233606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:36.263206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 460/919] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:36.266467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:36.332650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 460/920] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:36.603818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:36.617088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:36.719602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b045-d3bb-41a5-ba70-76460c376571 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:36.758739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:36.759378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.759661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.759937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.760526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:36.761907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:36.765808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c7c93-c1e4-4335-bc0d-cbd3cc49f25c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.766226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c7c93-c1e4-4335-bc0d-cbd3cc49f25c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.766528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c7c93-c1e4-4335-bc0d-cbd3cc49f25c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.768018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 461/921] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:36.771430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:36.772376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:36.773182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 461/922] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:36.775825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce551-64e0-4cd8-a45b-7eda68dbb2db None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.776110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce551-64e0-4cd8-a45b-7eda68dbb2db None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.776386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce551-64e0-4cd8-a45b-7eda68dbb2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.778176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:36.794520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a67ce551-64e0-4cd8-a45b-7eda68dbb2db None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:36.795782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a67ce551-64e0-4cd8-a45b-7eda68dbb2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:36.868524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:36.871069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 462/923] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:36.900258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e748-5c68-44b4-9119-40a797d24c8a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:36.939583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:36.940230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:36.940518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:36.940794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:36.941434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:36.941735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:36.943210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:36.948509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 462/924] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:36.954293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ce551-64e0-4cd8-a45b-7eda68dbb2db None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:37.039073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:37.055526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ce551-64e0-4cd8-a45b-7eda68dbb2db None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:37.090640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:37.091248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:37.091525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:37.091795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:37.092483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:37.092788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:37.094152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:37.099513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 463/925] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:37.105233 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:37.155061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:37.227923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055d2ed-1add-43f8-be60-622eb19a98c9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:37.272366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7aed-bfc8-40b6-a62b-efd68323b545 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:37.277185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:37.278099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:37.278558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:37.279059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:37.280543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] RBAC: Adding query filter params (interface=public, service_id=b37fb7357bb94f47b9a1e29206b8fc1d, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:37.281068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:37.282678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:37.288617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 463/926] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:23:37 2022] GET /identity/v3/endpoints?service_id=b37fb7357bb94f47b9a1e29206b8fc1d&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:37.298394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:37.298394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:37.321458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:37.322167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:37.322877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:37.323162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:37.323745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:37.325636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:37.337493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:37.338469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 04:23:37.339360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:37.342911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 464/927] 10.222.0.52 () {56 vars in 1132 bytes} [Sun Sep 25 04:23:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:37.344873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:37.360120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:37.421056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df76f8e-8870-44f4-b712-9f0f36363031 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:37.459059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:37.460194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:37.460673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:37.461140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:37.461961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:37.462628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5a07f-514d-4b61-8362-99639397e3d1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:37.463876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:37.478989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 464/928] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:37 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:23:37.504150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:37.504782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:37.505061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:37.505336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:37.505980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:37.506280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:37.507704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:37.513668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 465/929] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:37.520116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:37.597432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:37.637704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775909-44b4-44a7-b683-195332b9c122 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:37.674700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802ee6a-20d2-4731-a5d2-7ada871105f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:37.675599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ee6a-20d2-4731-a5d2-7ada871105f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:37.675875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ee6a-20d2-4731-a5d2-7ada871105f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:37.676145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ee6a-20d2-4731-a5d2-7ada871105f4 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:37.676772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802ee6a-20d2-4731-a5d2-7ada871105f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:37.677068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802ee6a-20d2-4731-a5d2-7ada871105f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:37.678490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802ee6a-20d2-4731-a5d2-7ada871105f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:37.683578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 465/930] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:37.689276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:37.773388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:37.801234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20f82-71ca-4f71-97fd-e8b9a3a78589 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:37.837634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a181d-94fb-4774-9f2b-0011436061e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:37.838252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a181d-94fb-4774-9f2b-0011436061e9 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:37.838575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a181d-94fb-4774-9f2b-0011436061e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:37.838850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a181d-94fb-4774-9f2b-0011436061e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:37.839537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a181d-94fb-4774-9f2b-0011436061e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:37.840915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a181d-94fb-4774-9f2b-0011436061e9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:37.863671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 466/931] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:38.048001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e6b4-7c50-4cd4-8065-5a6c39bad3ec None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:38.048493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e6b4-7c50-4cd4-8065-5a6c39bad3ec None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:38.048493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e6b4-7c50-4cd4-8065-5a6c39bad3ec None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:38.049820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 466/932] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:38.055184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb2c54-8a21-4a2d-921b-895232537669 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:38.055593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb2c54-8a21-4a2d-921b-895232537669 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:38.055746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb2c54-8a21-4a2d-921b-895232537669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:38.075569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1bbb2c54-8a21-4a2d-921b-895232537669 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:38.076906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1bbb2c54-8a21-4a2d-921b-895232537669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:38.158192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 467/933] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:38.431716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e6b4-7c50-4cd4-8065-5a6c39bad3ec None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:38.548283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e6b4-7c50-4cd4-8065-5a6c39bad3ec None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:38.577810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:38.584289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:38.585117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:38.585399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:38.585674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:38.596748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3836-277c-4def-8c4e-c5dc7416d31c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:38.597030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3836-277c-4def-8c4e-c5dc7416d31c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:38.597136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:38.597312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3836-277c-4def-8c4e-c5dc7416d31c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:38.598994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 468/934] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:38.602126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:38.603039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:38.603855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 467/935] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Sep 25 04:23:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:38.604517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13406070-227e-4ed5-9559-f9dd0a61a015 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:38.604517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13406070-227e-4ed5-9559-f9dd0a61a015 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:38.604517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13406070-227e-4ed5-9559-f9dd0a61a015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:38.613188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:38.628897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-13406070-227e-4ed5-9559-f9dd0a61a015 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:38.631004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-13406070-227e-4ed5-9559-f9dd0a61a015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:38.699661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:38.722379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 469/936] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:38.729188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4890af-9724-48d8-8038-08e0cac1fcf8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:38.763817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:38.764975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:38.765258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:38.765530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:38.766196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:38.766534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:38.767964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:38.776770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 468/937] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Sep 25 04:23:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:38.782436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13406070-227e-4ed5-9559-f9dd0a61a015 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:38.889374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13406070-227e-4ed5-9559-f9dd0a61a015 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:38.925148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:38.925779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:38.926060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:38.926335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:38.937411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:38.938932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:38.953827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:38.954789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:38.955664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:38.955664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:38.955664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:38.955664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 470/938] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:38.961945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.022022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:39.025217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.077072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:39.086917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c50ac-5b23-4d00-9eb6-802f60edc5c1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.133306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.133306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.133306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.133306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.133705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:39.133705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.135055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.143477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b688f7-e782-4390-ba1e-21bd35996e9d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.154504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 469/939] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:39.159924 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.188673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.189627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.189916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.190521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.191197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.193075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.198291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING keystone.server.flask.common [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 25 04:23:39.218888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.sql.core [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 04:23:39.218888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 04:23:39.218888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [parameters: {'id': '7491ab8c94e042a59188dd3a652146ed', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 04:23:39.218888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7491ab8c94e042a59188dd3a652146ed.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7491ab8c94e042a59188dd3a652146ed. Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application conn.query(q) Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 04:23:39.242289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result.read() Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 25 04:23:39.243200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application next(self.gen) Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application yield resource Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application next(self.gen) Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise self.value Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application session.commit() Sep 25 04:23:39.244145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.session.flush() Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application compat.raise_( Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 04:23:39.245025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 04:23:39.245918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application conn.query(q) Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result.read() Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 04:23:39.246723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [parameters: {'id': '7491ab8c94e042a59188dd3a652146ed', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:39.247582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:39.248352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7491ab8c94e042a59188dd3a652146ed. Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.249333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 471/940] 10.222.0.52 () {60 vars in 1140 bytes} [Sun Sep 25 04:23:39 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:39.259627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.277120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f8c5-8df2-47e3-870f-391cee75e8a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.296028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:39.322980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.324077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.324725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.325204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.333858 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.335824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:39.349010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:39.349923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:39.350889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:39.353387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 470/941] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:23:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:39.359717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.383118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:39.390300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad2734-bdce-428e-ab4b-4733099d7803 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.428971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.429773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.430161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.430587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.438317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.440208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:39.456570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:39.457582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:39.458476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:39.458909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 472/942] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:39.464671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.479744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80d35-8387-44f6-a592-7aecd2753f68 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.530273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.531129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.531426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.531706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.532446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:39.533049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.534532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.557068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 471/943] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Sep 25 04:23:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:39.563149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.597039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bcc9e-cb84-45f8-8e89-6ab5bd3107a8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.603766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:39.649889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018ca2-7fed-4944-8000-9bccde1f7f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.650744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018ca2-7fed-4944-8000-9bccde1f7f7d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.651126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018ca2-7fed-4944-8000-9bccde1f7f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.651499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018ca2-7fed-4944-8000-9bccde1f7f7d None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.652326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018ca2-7fed-4944-8000-9bccde1f7f7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:39.652727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018ca2-7fed-4944-8000-9bccde1f7f7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.654653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018ca2-7fed-4944-8000-9bccde1f7f7d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.686531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 473/944] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:39.699960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b96d8-7f40-4f93-92b3-abb56115487d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.733287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1929-dc5f-49fc-a9d3-6f4e0e63a4b1 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.733579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1929-dc5f-49fc-a9d3-6f4e0e63a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.733760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1929-dc5f-49fc-a9d3-6f4e0e63a4b1 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.735494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 474/945] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:39.741778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59737-1b55-42a6-aa52-5db14423f5d5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.742460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59737-1b55-42a6-aa52-5db14423f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.742938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59737-1b55-42a6-aa52-5db14423f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.744976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.745644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.745927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.746204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.760827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.762387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.764935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f5e59737-1b55-42a6-aa52-5db14423f5d5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:39.766844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f5e59737-1b55-42a6-aa52-5db14423f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:39.780797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:39.782863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:39.783999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:39.784877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:39.784877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:39.784877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:39.784877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 472/946] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:39.790288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:39.870923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 475/947] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:39.917085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:39.919593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80917-144f-40af-b726-ccf1f476782f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:39.955654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:39.956626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:39.957070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:39.957493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:39.958290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:39.958764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:39.960367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:39.977645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 473/948] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:39.979099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59737-1b55-42a6-aa52-5db14423f5d5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.092693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59737-1b55-42a6-aa52-5db14423f5d5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.128794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da865a-9600-478a-82ee-f0cff6c7e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.129430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da865a-9600-478a-82ee-f0cff6c7e53d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.129707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da865a-9600-478a-82ee-f0cff6c7e53d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.129979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da865a-9600-478a-82ee-f0cff6c7e53d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.137086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da865a-9600-478a-82ee-f0cff6c7e53d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.139101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da865a-9600-478a-82ee-f0cff6c7e53d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.144400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a7da865a-9600-478a-82ee-f0cff6c7e53d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:40.151457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:40.152332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:40.153208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 476/949] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:40.159225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa9b6-bc87-45cc-a1b6-23bf353e5cce None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.159514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa9b6-bc87-45cc-a1b6-23bf353e5cce None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.159791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa9b6-bc87-45cc-a1b6-23bf353e5cce None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.161263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 477/950] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:40.161904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baa9b6-bc87-45cc-a1b6-23bf353e5cce None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.171813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:40.265835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ff9f5-559e-4aae-8f2f-dfd672dd46fa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.275969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baa9b6-bc87-45cc-a1b6-23bf353e5cce None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.304212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8d93e-887d-4d7e-8e19-42a96f4b5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.304854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d93e-887d-4d7e-8e19-42a96f4b5e6b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.305133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d93e-887d-4d7e-8e19-42a96f4b5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.305411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d93e-887d-4d7e-8e19-42a96f4b5e6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.305990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8d93e-887d-4d7e-8e19-42a96f4b5e6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.307402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8d93e-887d-4d7e-8e19-42a96f4b5e6b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.314267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.314910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.315194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.315469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.316165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:40.316472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.317891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d9b8d93e-887d-4d7e-8e19-42a96f4b5e6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:40.319139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:40.320334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:40.321399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:40.329652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 474/951] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:40.330792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abf950-79d8-45be-9677-68820b6e7d03 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.331079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abf950-79d8-45be-9677-68820b6e7d03 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.331355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abf950-79d8-45be-9677-68820b6e7d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.334610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 478/952] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:40.335641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.349602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:40.356177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-51abf950-79d8-45be-9677-68820b6e7d03 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:40.357392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-51abf950-79d8-45be-9677-68820b6e7d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:40.410081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:40.429436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 475/953] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:40.430255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abf950-79d8-45be-9677-68820b6e7d03 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.458712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767830c-5195-4a4d-b416-a04dbdaea4aa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.496480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.497462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.497950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.498507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.500212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:40.501030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.503275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.514865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 479/954] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:40.516083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.541036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abf950-79d8-45be-9677-68820b6e7d03 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.578145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.578835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.579114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.579389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/7edd6fd40289457d94e4ae4b7a26be80/roles/9e75c2c3089d4100bc098bf0beb85827` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.582339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=7edd6fd40289457d94e4ae4b7a26be80, role_id=9e75c2c3089d4100bc098bf0beb85827)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.584340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.588019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:40.610458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 476/955] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:23:40 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/7edd6fd40289457d94e4ae4b7a26be80/roles/9e75c2c3089d4100bc098bf0beb85827 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:23:40.634526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77654e-0c3a-4c15-87ba-67ad254423bb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.669621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:40.676720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.677401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.677684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.678007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.678688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:40.678994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.680403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.687029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 480/956] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:40.693380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.709198 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.830520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f266-be7b-4523-9dcf-bf9f5943aba9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.855436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc28d4-0c45-4b42-b961-5a124b508bca None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:40.876256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.877107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.877537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.877957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.878861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.881235 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.894567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:40.895447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:40.895837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:40.896318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] PATH_INFO: `/v3/services/compute` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:40.896988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:40.898468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:40.909305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 477/957] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:40.909835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:40.910975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:40.915683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 481/958] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:40.918091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:40.982548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:41.046730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c0724-f2a3-49b4-8976-6fb3348209f6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:41.085402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22007efd-0677-413c-96bf-9a3f95f7dc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:41.086043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007efd-0677-413c-96bf-9a3f95f7dc9f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:41.086327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007efd-0677-413c-96bf-9a3f95f7dc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:41.086628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007efd-0677-413c-96bf-9a3f95f7dc9f None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:41.087282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22007efd-0677-413c-96bf-9a3f95f7dc9f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:41.087585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22007efd-0677-413c-96bf-9a3f95f7dc9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:41.089002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22007efd-0677-413c-96bf-9a3f95f7dc9f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:41.100003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 478/959] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:41.103495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:41.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:41.220430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c58d4-c66b-41de-a488-f5d332a17cef None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:41.255334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf97a9-40bd-40c2-8645-9ecc9f123fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:41.255955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf97a9-40bd-40c2-8645-9ecc9f123fef None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:41.256237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf97a9-40bd-40c2-8645-9ecc9f123fef None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:41.256513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf97a9-40bd-40c2-8645-9ecc9f123fef None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:41.257145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf97a9-40bd-40c2-8645-9ecc9f123fef None admin] RBAC: Adding query filter params (type=compute) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:41.257448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf97a9-40bd-40c2-8645-9ecc9f123fef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:41.258859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf97a9-40bd-40c2-8645-9ecc9f123fef None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:41.270515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 482/960] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:41.994440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f532f-6f09-4650-bd91-52c30b23997d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:41.994953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f532f-6f09-4650-bd91-52c30b23997d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:41.995028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f532f-6f09-4650-bd91-52c30b23997d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:41.996679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 479/961] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:42.002494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e509-7d34-48f0-a2e8-ffb5c3f63ab2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:42.002783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e509-7d34-48f0-a2e8-ffb5c3f63ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:42.003062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e509-7d34-48f0-a2e8-ffb5c3f63ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:42.021634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9582e509-7d34-48f0-a2e8-ffb5c3f63ab2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:42.022853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9582e509-7d34-48f0-a2e8-ffb5c3f63ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:42.094440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 483/962] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:42.365204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f532f-6f09-4650-bd91-52c30b23997d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:42.471127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f532f-6f09-4650-bd91-52c30b23997d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:42.486722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:42.506451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:42.507071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:42.507354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:42.507629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:42.508283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:42.509785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:42.512328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING keystone.server.flask.common [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 25 04:23:42.525868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.sql.core [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 04:23:42.525868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 25 04:23:42.525868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [parameters: {'user_id': '5516b46e0da94ea0be7053c75825148f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 25 04:23:42.525868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 25 04:23:42.534002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 04:23:42.534913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application yield resource Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise self.value Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application session.commit() Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 04:23:42.535879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.flush() Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application compat.raise_( Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 04:23:42.536747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 04:23:42.537609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 04:23:42.539335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [parameters: {'user_id': '5516b46e0da94ea0be7053c75825148f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:42.541332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 25 04:23:42.543224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 25 04:23:42.544942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 25 04:23:42.544942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 25 04:23:42.544942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 04:23:42.544942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 04:23:42.544942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 25 04:23:42.544942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:42.544942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 480/963] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Sep 25 04:23:42 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:42.545482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582e509-7d34-48f0-a2e8-ffb5c3f63ab2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:42.597829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:42.651945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582e509-7d34-48f0-a2e8-ffb5c3f63ab2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:42.688922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cf8f5-a554-46d7-bda1-448f590278cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:42.689563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf8f5-a554-46d7-bda1-448f590278cc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:42.689844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf8f5-a554-46d7-bda1-448f590278cc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:42.690119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf8f5-a554-46d7-bda1-448f590278cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:42.697576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cf8f5-a554-46d7-bda1-448f590278cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:42.699048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cf8f5-a554-46d7-bda1-448f590278cc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1d2cf8f5-a554-46d7-bda1-448f590278cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:42.710888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:42.712846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:42.715007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 484/964] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:42.719840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:42.830991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d04796-a81a-49b5-ab88-e70548e62b8f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:42.869474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f25adf-1357-4631-bf01-e96c5c309f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:42.870095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f25adf-1357-4631-bf01-e96c5c309f3a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:42.872168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f25adf-1357-4631-bf01-e96c5c309f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:42.872168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f25adf-1357-4631-bf01-e96c5c309f3a None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:42.872168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f25adf-1357-4631-bf01-e96c5c309f3a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:42.872168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f25adf-1357-4631-bf01-e96c5c309f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:42.887414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f25adf-1357-4631-bf01-e96c5c309f3a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:42.917107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 481/965] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Sep 25 04:23:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:42.952917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ecf48-0e3a-4b06-b919-e64059113fad None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:42.953235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ecf48-0e3a-4b06-b919-e64059113fad None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:42.953475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ecf48-0e3a-4b06-b919-e64059113fad None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:42.956412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 485/966] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:42.961163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce97e5-ff44-4f4c-a835-35d5e98824de None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:42.961449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce97e5-ff44-4f4c-a835-35d5e98824de None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:42.961730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce97e5-ff44-4f4c-a835-35d5e98824de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:42.982116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-96ce97e5-ff44-4f4c-a835-35d5e98824de None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:42.984296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-96ce97e5-ff44-4f4c-a835-35d5e98824de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:43.015403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:43.065943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 482/967] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:43.174537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc06a-c791-44d0-9d65-245482c525ec None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.174863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc06a-c791-44d0-9d65-245482c525ec None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.175095 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc06a-c791-44d0-9d65-245482c525ec None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.176707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 486/968] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:43.182102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66641cb-b90c-406e-9ea7-f92ee70fb271 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.182423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66641cb-b90c-406e-9ea7-f92ee70fb271 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.182707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66641cb-b90c-406e-9ea7-f92ee70fb271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.201217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e66641cb-b90c-406e-9ea7-f92ee70fb271 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:43.202984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e66641cb-b90c-406e-9ea7-f92ee70fb271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:43.275213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 483/969] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:43.344879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fc06a-c791-44d0-9d65-245482c525ec None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:43.454128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fc06a-c791-44d0-9d65-245482c525ec None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:43.466892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:43.490493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:43.491188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.491469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.491790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.499677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee946-b22e-4984-a217-03cb99d2eecf None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.499964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee946-b22e-4984-a217-03cb99d2eecf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.500234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee946-b22e-4984-a217-03cb99d2eecf None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.501697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 484/970] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:43.502783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:43.506301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d972f-e61f-48a3-8eba-171965140a50 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.506615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d972f-e61f-48a3-8eba-171965140a50 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.506887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d972f-e61f-48a3-8eba-171965140a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:43.507879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:43.508765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:43.509602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:43.513840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 487/971] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Sep 25 04:23:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:43.514975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:43.526034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7f8d972f-e61f-48a3-8eba-171965140a50 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:43.527336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f8d972f-e61f-48a3-8eba-171965140a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:43.595505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 485/972] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:43.596183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d972f-e61f-48a3-8eba-171965140a50 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:43.622281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:43.631334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28428925-32ef-4748-8b1c-e856a0fa30cb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:43.668367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:43.669248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.669672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.670087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.671469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:43.671947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:43.673443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:43.682376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 488/973] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Sep 25 04:23:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:43.688808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:43.714496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d972f-e61f-48a3-8eba-171965140a50 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:43.724120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:43.755496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:43.756132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.756413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.756687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.757269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:43.758674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:43.768523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:43.769702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:43.770728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 486/974] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:43.775165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:43.797290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b184d51-ea65-4ed0-9a84-5378317bd508 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:43.830543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:43.831168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.831444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.831715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.842442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:43.843873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:43.857558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:43.859040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:43.859922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:43.859922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:43.859922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:43.863856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 489/975] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:43.864724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:43.865116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:43.880969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2d842-19b7-4d12-80cf-1391683ada5e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:43.914462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:43.915067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.915342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.915611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:43.916229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:43.916527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:43.917880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:43.923185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 487/976] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:43.923947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:43.949856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:43.964718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b003c-f76b-4dc4-b24d-ab005f4f3f01 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:43.997988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:43.999208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:43.999489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:43.999752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.000388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.001743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.015914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 490/977] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:43 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:44.017052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.027718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f245-5d5f-41af-8126-92ccbab53ac8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.077085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.077722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.078007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.078274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.079015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:44.079453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.081008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.096248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 488/978] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:44.101968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.112994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:44.137168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d40d-3d5d-48bb-9ee5-4728dc0f31eb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.176226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.177002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.177242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.177514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.178181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:44.178470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.179848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.185288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 491/979] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:44.191817 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.206702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:44.218941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff61a6-a056-462f-9f51-03ea5df91806 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.262976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.263656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.263977 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.264350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.271826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.273359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:44.285556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:44.286597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 04:23:44.287634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:44.289132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 489/980] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:44.292581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.314770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7005-4c71-4746-8753-f7bc1974c83b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.351049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.352022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.352633 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.353106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.354066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] RBAC: Adding query filter params (interface=admin, service_id=b37fb7357bb94f47b9a1e29206b8fc1d, region_id=RegionOne) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:44.354478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.355984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.359683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:44.365330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 492/981] 10.222.0.52 () {56 vars in 1249 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/endpoints?service_id=b37fb7357bb94f47b9a1e29206b8fc1d&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:44.370706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.396976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c54ccc-ec15-454c-b539-c3ff2eb2d7ed None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.430939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.431552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.431827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.432098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.432823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:44.433126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.434640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.450637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:44.458822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 490/982] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:44.459998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.478415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7774b-34c2-41b4-9845-d6c1be1a437a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.518329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.518967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.519248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.519522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.520124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.521494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.527903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 493/983] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:23:44.573741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0989be-127b-4018-a6e0-146f35c62c4d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.601171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:44.613977 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.614640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.614921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.615254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.689386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.690873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.793611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 491/984] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 04:23:44.799494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.900261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31b767-a79a-48a2-9046-65218e041a7a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:44.936474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:44.937115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:44.937390 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:44.937660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:44.944765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:44.949560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:44.951037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:44.964945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:44.965868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:44.966806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:44.966806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:44.966806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:44.966806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 494/985] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:44.973316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:44.997370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:45.087685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9349-3c52-4f3a-b380-7df51f852fec None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:45.121161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:45.121771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:45.122053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:45.122325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:45.122990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:45.123817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:45.125200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:45.139076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 492/986] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:45.145300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:45.249817 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fa126-78b9-4f58-8f8a-bcbbef4b3499 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:45.289631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:45.290269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:45.290577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:45.290850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:45.298074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:45.299554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:45.312743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:45.313696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:45.314584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 495/987] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:45.319803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:45.407050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:45.427375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca06e0-b335-49cf-bd17-24ac22a145f5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:45.461990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb87876-4828-43df-97f5-914a75563311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:45.462626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87876-4828-43df-97f5-914a75563311 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:45.462913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87876-4828-43df-97f5-914a75563311 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:45.463192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87876-4828-43df-97f5-914a75563311 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:45.463881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87876-4828-43df-97f5-914a75563311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:45.464189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87876-4828-43df-97f5-914a75563311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:45.465616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87876-4828-43df-97f5-914a75563311 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:45.477984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 493/988] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:45.484027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:45.534063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:45.584963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d886d-1e94-441d-a559-782746e514c3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:45.618682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2d3e-c30b-45ed-b169-94fc7e6c77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:45.619289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2d3e-c30b-45ed-b169-94fc7e6c77ac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:45.619571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2d3e-c30b-45ed-b169-94fc7e6c77ac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:45.619847 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2d3e-c30b-45ed-b169-94fc7e6c77ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:45.620571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2d3e-c30b-45ed-b169-94fc7e6c77ac None admin] RBAC: Adding query filter params (role.id=9e75c2c3089d4100bc098bf0beb85827, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=7edd6fd40289457d94e4ae4b7a26be80) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:45.620881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2d3e-c30b-45ed-b169-94fc7e6c77ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:45.622316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2d3e-c30b-45ed-b169-94fc7e6c77ac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:45.634455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 496/989] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:45 2022] GET /identity/v3/role_assignments?user.id=7edd6fd40289457d94e4ae4b7a26be80&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=9e75c2c3089d4100bc098bf0beb85827 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:46.217855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b636d-16b9-4892-80f0-c7d43730982e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:46.218429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b636d-16b9-4892-80f0-c7d43730982e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:46.218429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b636d-16b9-4892-80f0-c7d43730982e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:46.219810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 494/990] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:46.224964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f934a1-118a-49da-94b0-6667d250dfbb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:46.225378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f934a1-118a-49da-94b0-6667d250dfbb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:46.225592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f934a1-118a-49da-94b0-6667d250dfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:46.243862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-92f934a1-118a-49da-94b0-6667d250dfbb None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:46.245058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-92f934a1-118a-49da-94b0-6667d250dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:46.319454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 497/991] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:46.586335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b636d-16b9-4892-80f0-c7d43730982e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:46.691782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b636d-16b9-4892-80f0-c7d43730982e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:46.701280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0511282-0832-4b4c-8c23-87d7bea6668b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:46.702111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0511282-0832-4b4c-8c23-87d7bea6668b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:46.702420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0511282-0832-4b4c-8c23-87d7bea6668b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:46.703775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 498/992] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:46.708585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22804d1-c722-4d13-a7fb-e0112a1c8366 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:46.708864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22804d1-c722-4d13-a7fb-e0112a1c8366 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:46.709144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22804d1-c722-4d13-a7fb-e0112a1c8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:46.726292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:46.726981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:46.727217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:46.727484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:46.727806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f22804d1-c722-4d13-a7fb-e0112a1c8366 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:46.728054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:46.729005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f22804d1-c722-4d13-a7fb-e0112a1c8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:46.729404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:46.738741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:46.739745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:46.740585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:46.744655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 495/993] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:46.745421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:46.756432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:46.774182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:46.810684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 499/994] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:46.850842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a39c47-fac4-4729-a7f0-5d7398ac7465 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:46.884747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:46.885364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:46.885647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:46.885920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:46.886570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:46.886877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:46.888241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:46.898362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 496/995] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:46.899827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22804d1-c722-4d13-a7fb-e0112a1c8366 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:47.013057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22804d1-c722-4d13-a7fb-e0112a1c8366 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:47.046869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:47.047475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.047749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.048019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.048639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:47.048938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:47.050286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:47.056058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 500/996] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:47.061598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:47.076242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:47.116947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:47.138754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:47.169913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c1718-7a44-413f-a54d-72db0530c369 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:47.178976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96289a46-dbf6-4be1-8592-8cc0c13bfcf9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:47.204826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:47.205520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.205866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.206208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.206997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] RBAC: Adding query filter params (interface=public, service_id=c2957bdfd0d145d0b806a360b922de64, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:47.207373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:47.208737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:47.214015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 497/997] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:23:47 2022] GET /identity/v3/endpoints?service_id=c2957bdfd0d145d0b806a360b922de64&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:47.214468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:47.215200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.215588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.215957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.216636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:47.218655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:47.220002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:47.228204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:47.229635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 04:23:47.231256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:47.232423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 501/998] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Sep 25 04:23:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:47.235184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:47.338852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2bc31-4bb5-48c7-8818-460deaffaecb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:47.348359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd435-633b-467d-87cf-1651d358e37d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:47.350377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:47.372224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:47.372836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.373114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.373909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.374543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:47.376015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:47.377722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:47.383026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 498/999] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:47 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:23:47.397201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:47.397939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.398294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.398717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.399506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:47.399958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:47.401487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:47.408061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 502/1000] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:47.413778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:47.522859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0b3d-c73f-4beb-8d02-55cf90077ae9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:47.561348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a928-ecf6-46ea-a8cf-caeece4bfcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:47.561966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a928-ecf6-46ea-a8cf-caeece4bfcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.562245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a928-ecf6-46ea-a8cf-caeece4bfcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.562600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a928-ecf6-46ea-a8cf-caeece4bfcf0 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.563242 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a928-ecf6-46ea-a8cf-caeece4bfcf0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:47.563545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a928-ecf6-46ea-a8cf-caeece4bfcf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:47.564929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a928-ecf6-46ea-a8cf-caeece4bfcf0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:47.569775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 499/1001] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Sep 25 04:23:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:47.575682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:47.678365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a3c1-949c-44d3-96e7-2e76b1eae808 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:47.713763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85cf85-31bb-4024-8cb9-9272859346c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:47.714425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85cf85-31bb-4024-8cb9-9272859346c4 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.714710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85cf85-31bb-4024-8cb9-9272859346c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.714984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85cf85-31bb-4024-8cb9-9272859346c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.715681 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85cf85-31bb-4024-8cb9-9272859346c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:47.717191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85cf85-31bb-4024-8cb9-9272859346c4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:47.735444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 503/1002] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:47.829384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412539f-0393-4b0f-bf25-6a97379c70f9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.829739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412539f-0393-4b0f-bf25-6a97379c70f9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.829942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412539f-0393-4b0f-bf25-6a97379c70f9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.831362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 500/1003] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:47.837013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad9d96-76b1-40a7-ad57-e9e7eda2db4a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:47.837304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad9d96-76b1-40a7-ad57-e9e7eda2db4a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:47.837583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad9d96-76b1-40a7-ad57-e9e7eda2db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:47.857237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-51ad9d96-76b1-40a7-ad57-e9e7eda2db4a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:47.858620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-51ad9d96-76b1-40a7-ad57-e9e7eda2db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:47.882410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:47.943054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 504/1004] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:48.220395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412539f-0393-4b0f-bf25-6a97379c70f9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:48.295185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:48.335935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412539f-0393-4b0f-bf25-6a97379c70f9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:48.369840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:48.370497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:48.370782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:48.371060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] PATH_INFO: `/v3/services/image` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:48.371640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:48.373017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:48.381891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:48.383304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:48.384197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:48.385575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 501/1005] 10.222.0.52 () {56 vars in 1105 bytes} [Sun Sep 25 04:23:48 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:48.389421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad9d96-76b1-40a7-ad57-e9e7eda2db4a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:48.491108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad9d96-76b1-40a7-ad57-e9e7eda2db4a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:48.524859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e772e-523a-4dce-ac9f-58fb8ef31dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:48.525473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e772e-523a-4dce-ac9f-58fb8ef31dcb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:48.525756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e772e-523a-4dce-ac9f-58fb8ef31dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:48.526031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e772e-523a-4dce-ac9f-58fb8ef31dcb None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:48.526689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e772e-523a-4dce-ac9f-58fb8ef31dcb None admin] RBAC: Adding query filter params (name=image) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:48.526996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e772e-523a-4dce-ac9f-58fb8ef31dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:48.528359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e772e-523a-4dce-ac9f-58fb8ef31dcb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:48.537848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 505/1006] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:48.538970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:48.647588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630d8f5-787d-4461-a125-d281cd8f834b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:48.674510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:48.683624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c085737-f9ac-49f8-a89c-19fcc5cd5662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:48.684240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c085737-f9ac-49f8-a89c-19fcc5cd5662 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:48.684524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c085737-f9ac-49f8-a89c-19fcc5cd5662 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:48.684801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c085737-f9ac-49f8-a89c-19fcc5cd5662 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:48.686236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c085737-f9ac-49f8-a89c-19fcc5cd5662 None admin] RBAC: Adding query filter params (type=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:48.686571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c085737-f9ac-49f8-a89c-19fcc5cd5662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:48.687949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c085737-f9ac-49f8-a89c-19fcc5cd5662 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:48.692585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 502/1007] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:49.560399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb4078-847d-46d2-9b2e-51326d0f0946 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:49.561453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb4078-847d-46d2-9b2e-51326d0f0946 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:49.561453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb4078-847d-46d2-9b2e-51326d0f0946 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:49.562944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 506/1008] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:49.568692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3865c0-c33e-4435-9958-b89a3b6f68d4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:49.569123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3865c0-c33e-4435-9958-b89a3b6f68d4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:49.569302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3865c0-c33e-4435-9958-b89a3b6f68d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:49.587919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fa3865c0-c33e-4435-9958-b89a3b6f68d4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:49.589118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa3865c0-c33e-4435-9958-b89a3b6f68d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:49.658485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 503/1009] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:49.888031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5e98-f365-4871-8d6b-41811580aa15 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:49.888316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5e98-f365-4871-8d6b-41811580aa15 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:49.888591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f5e98-f365-4871-8d6b-41811580aa15 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:49.890492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 507/1010] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:49.895921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712dd6f-736d-4f27-ab98-abb0fff68e90 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:49.896214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712dd6f-736d-4f27-ab98-abb0fff68e90 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:49.896493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712dd6f-736d-4f27-ab98-abb0fff68e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:49.916017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8712dd6f-736d-4f27-ab98-abb0fff68e90 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:49.917224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8712dd6f-736d-4f27-ab98-abb0fff68e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:49.923552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f5e98-f365-4871-8d6b-41811580aa15 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:49.942245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:49.991076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 504/1011] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:50.034665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f5e98-f365-4871-8d6b-41811580aa15 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:50.069174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:50.069801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.070081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.070370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.070952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:50.072311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:50.081205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:50.082220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:50.083538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 508/1012] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:50.088279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712dd6f-736d-4f27-ab98-abb0fff68e90 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:50.141998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:50.189516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712dd6f-736d-4f27-ab98-abb0fff68e90 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:50.225086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:50.225697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.225979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.226254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.226913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:50.227217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:50.228638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:50.238383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 505/1013] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:50.240007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:50.266517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:50.336829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:50.358541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0e73-fea0-4002-9b3b-32fcd5412f01 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:50.370219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9b3b4-1b92-48d4-94ca-7e6cc865b28e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:50.387343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:50.398255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:50.399138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.399422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.399811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.400323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:50.400627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:50.401984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:50.407315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:50.407842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 509/1014] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Sep 25 04:23:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:50.407950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.408230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.408509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.409639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:50.411108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:50.413325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:50.414386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 506/1015] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:50.418121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:50.522835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cb1d5-a05b-47c3-9c9f-1f0b84751aa2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:50.524008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf57e0-e224-4bff-816d-aa45a31e8417 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:50.559846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb26c1-3500-435c-9058-37da8444f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:50.560750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb26c1-3500-435c-9058-37da8444f7de None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.561027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb26c1-3500-435c-9058-37da8444f7de None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.561298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb26c1-3500-435c-9058-37da8444f7de None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.561940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb26c1-3500-435c-9058-37da8444f7de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:50.562209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a489eb1-2a97-48e7-8e0b-f6f5caa1cbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:50.562850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489eb1-2a97-48e7-8e0b-f6f5caa1cbad None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.563130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489eb1-2a97-48e7-8e0b-f6f5caa1cbad None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.563397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb26c1-3500-435c-9058-37da8444f7de None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:50.563505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489eb1-2a97-48e7-8e0b-f6f5caa1cbad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.564064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a489eb1-2a97-48e7-8e0b-f6f5caa1cbad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:50.565463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a489eb1-2a97-48e7-8e0b-f6f5caa1cbad None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:50.583914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:50.590898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 510/1016] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:23:50.604576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 507/1017] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:50 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:23:50.854616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3f82-7c60-4792-9b68-84f6894f8e86 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.854811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3f82-7c60-4792-9b68-84f6894f8e86 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.855085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3f82-7c60-4792-9b68-84f6894f8e86 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.856605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 511/1018] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:50.862340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8842-bd14-488c-ac94-b81d6590d097 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:50.862657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8842-bd14-488c-ac94-b81d6590d097 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:50.862937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8842-bd14-488c-ac94-b81d6590d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:50.881176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b7bb8842-bd14-488c-ac94-b81d6590d097 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:50.882389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b7bb8842-bd14-488c-ac94-b81d6590d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:50.913426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:50.959125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 508/1019] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:50 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:51.225015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3f82-7c60-4792-9b68-84f6894f8e86 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:51.330833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3f82-7c60-4792-9b68-84f6894f8e86 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:51.365682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32989377-e3e4-4dff-af52-3a247b4dcfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:51.366291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989377-e3e4-4dff-af52-3a247b4dcfd1 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:51.366598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989377-e3e4-4dff-af52-3a247b4dcfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:51.366868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989377-e3e4-4dff-af52-3a247b4dcfd1 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:51.367528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32989377-e3e4-4dff-af52-3a247b4dcfd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:51.368890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32989377-e3e4-4dff-af52-3a247b4dcfd1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:51.390433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 512/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:23:51 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:23:52.842795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc00a-bc43-4623-9837-c919c643a51f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:52.843308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc00a-bc43-4623-9837-c919c643a51f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:52.843385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc00a-bc43-4623-9837-c919c643a51f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:52.844719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 509/1021] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:52.849912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b311869-3bbc-4210-8a9e-ec41205fa515 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:52.850320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b311869-3bbc-4210-8a9e-ec41205fa515 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:52.850565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b311869-3bbc-4210-8a9e-ec41205fa515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:52.868418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4b311869-3bbc-4210-8a9e-ec41205fa515 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:52.869600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4b311869-3bbc-4210-8a9e-ec41205fa515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:52.908223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628f76-b0fb-465b-be8b-226e08f52472 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:52.908507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628f76-b0fb-465b-be8b-226e08f52472 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:52.908977 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628f76-b0fb-465b-be8b-226e08f52472 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:52.910320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 510/1022] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:52.915793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9a84-e622-41c4-93e7-311b17680a3e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:52.916327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9a84-e622-41c4-93e7-311b17680a3e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:52.916595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9a84-e622-41c4-93e7-311b17680a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:52.927947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:52.940446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cdab9a84-e622-41c4-93e7-311b17680a3e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:52.941669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cdab9a84-e622-41c4-93e7-311b17680a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:52.949173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 513/1023] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:53.009646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 511/1024] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:53.214022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b311869-3bbc-4210-8a9e-ec41205fa515 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:53.285369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab9a84-e622-41c4-93e7-311b17680a3e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:53.322903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b311869-3bbc-4210-8a9e-ec41205fa515 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:53.358714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:53.359354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.359636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.359910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.361010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:53.362467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:53.366384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 514/1025] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:53.369624 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:53.386802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:53.398060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab9a84-e622-41c4-93e7-311b17680a3e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:53.426571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:53.436603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:53.437423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.437931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.438474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.452753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:53.458219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:53.459229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:53.460106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:53.461791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 512/1026] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Sep 25 04:23:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:53.468489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:53.479838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d795-a855-4f93-9f9d-39f3bcac8c07 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:53.513448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44fb00-2770-4e21-b4e4-aa8632479e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:53.514614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44fb00-2770-4e21-b4e4-aa8632479e90 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.514940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44fb00-2770-4e21-b4e4-aa8632479e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.515156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44fb00-2770-4e21-b4e4-aa8632479e90 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.515979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44fb00-2770-4e21-b4e4-aa8632479e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:53.517402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44fb00-2770-4e21-b4e4-aa8632479e90 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:53.540598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 515/1027] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:23:53 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:23:53.559166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154572d1-92e7-497f-84a8-3cb7c67cd1e9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.559455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154572d1-92e7-497f-84a8-3cb7c67cd1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.560168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154572d1-92e7-497f-84a8-3cb7c67cd1e9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.561626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 516/1028] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:53.567892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e17ba-e9af-4fd3-9893-2246d0526ff4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.568310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e17ba-e9af-4fd3-9893-2246d0526ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.568641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e17ba-e9af-4fd3-9893-2246d0526ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.589523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dd2e17ba-e9af-4fd3-9893-2246d0526ff4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:53.590798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dd2e17ba-e9af-4fd3-9893-2246d0526ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:53.598800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3676065-7036-4d53-83dd-bfc4c29d9d53 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:53.636469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:53.637101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.637394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.637663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.638383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:53.638729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:53.640166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:53.649014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 513/1029] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Sep 25 04:23:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:53.655097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:53.672095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:53.678387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 517/1030] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:53.767442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31d710-0676-484f-b50f-92f60643d13a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:53.802203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:53.802885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.803163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.803431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.815534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:53.816983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:53.831078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:53.832228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:53.833341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:53.833341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:53.833341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:53.833341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 514/1031] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:53.838006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e17ba-e9af-4fd3-9893-2246d0526ff4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:53.880630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:53.942568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e17ba-e9af-4fd3-9893-2246d0526ff4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:53.944253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:53.980242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:53.980839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:53.981160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:53.981386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:53.982074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:53.982318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:53.983698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:53.996806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 518/1032] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:54.002942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.019802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.057253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c7a6-45c3-43b2-b42a-6f0b476122f5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.095672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.096546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.097003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.097419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.098205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.099743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.109798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:54.110056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:54.110999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:54.111904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:54.113376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81d12-eeb0-490e-b4d7-939d784dec6b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.114524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 515/1033] 10.222.0.52 () {56 vars in 1105 bytes} [Sun Sep 25 04:23:53 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:54.120325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.149860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.150518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.150799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.151070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.162775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.164312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:54.175913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:54.176886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:54.177834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 519/1034] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:54.182694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.231201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c40a9-33c0-4570-9de1-f76279d88aa1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.267805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.274423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.275052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.275415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.275696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.276289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:54.276592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.277948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.283325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 516/1035] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:54.289120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.298219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126294e2-3dba-4bfb-b800-c62791e62761 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.335031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.335641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.335919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.336207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.337220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:54.337220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.338699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.356369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 520/1036] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:54.362461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.384051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.398290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2504-3c7d-4686-9778-9f3c7bd12edb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.434108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.434746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.435291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.436110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.436748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:54.437047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.438427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.443958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 517/1037] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:54.449482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.471695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617144e-8a6c-41c0-a15f-4cc829be6b3d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.508496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.509118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.509399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.509674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.510079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.558875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47ebcc-5416-4fdf-a55b-0ec8708350c9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.579798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.581271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.592355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.592955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.593232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.593508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.594199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] RBAC: Adding query filter params (interface=public, service_id=3dc854cbd67646be9542443489503825, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:54.594533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.595880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.599578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.605391 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 518/1038] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/endpoints?service_id=3dc854cbd67646be9542443489503825&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:54.607038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.694044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 521/1039] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 04:23:54.699590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:54.709615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ca511-367d-4695-8930-0d12fb1e5e06 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.734186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.746946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.747561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.747844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.748629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.749240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.750638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.757770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 519/1040] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:23:54.805558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffd4b4-826a-4a7e-9b78-a8ab3cfa52f8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:54.825715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:54.846069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:54.846749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:54.847028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:54.847299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:54.859428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:54.860972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:54.876976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:54.877968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:54.878876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:54.878876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:54.878876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:54.883124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 522/1041] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:54.884059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:55.005211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33d38e-f87d-44de-bb11-343f7c3b6d72 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:55.063519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:55.064143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:55.065269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:55.065269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:55.065475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:55.065643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:55.066999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:55.082161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 520/1042] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:55.088178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:55.191510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9a086-b2ed-4ca1-ac4c-676f34f49d25 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:55.225963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:55.226994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:55.227474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:55.227967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:55.235867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:55.237594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:55.249496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:55.250506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:55.251375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:55.258312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 523/1043] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:55.260622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:55.314171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:55.369591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d6b17-8e77-4bd1-a6a3-7d01a6f001c7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:55.405429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf521-021c-422f-9ddd-45ddb840ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:55.406044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf521-021c-422f-9ddd-45ddb840ea7f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:55.406318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf521-021c-422f-9ddd-45ddb840ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:55.406664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf521-021c-422f-9ddd-45ddb840ea7f None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:55.407349 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf521-021c-422f-9ddd-45ddb840ea7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:55.407654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf521-021c-422f-9ddd-45ddb840ea7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:55.409080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf521-021c-422f-9ddd-45ddb840ea7f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:55.427279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 521/1044] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:55.428872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:55.460593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:55.533289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e909a-58e6-47ae-b5e4-259d720e1e95 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:55.567253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb79fe6-507e-4e6f-9284-089730e8e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:55.567851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb79fe6-507e-4e6f-9284-089730e8e316 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:55.568128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb79fe6-507e-4e6f-9284-089730e8e316 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:55.568398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb79fe6-507e-4e6f-9284-089730e8e316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:55.569118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb79fe6-507e-4e6f-9284-089730e8e316 None admin] RBAC: Adding query filter params (role.id=9e75c2c3089d4100bc098bf0beb85827, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=079636b6d56943928420801c47555aea) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:55.569421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb79fe6-507e-4e6f-9284-089730e8e316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:55.570876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb79fe6-507e-4e6f-9284-089730e8e316 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:55.576514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 524/1045] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:55 2022] GET /identity/v3/role_assignments?user.id=079636b6d56943928420801c47555aea&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=9e75c2c3089d4100bc098bf0beb85827 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:55.792510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f942f-e6f1-4be0-80a6-5f2b85a39f38 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:55.792802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f942f-e6f1-4be0-80a6-5f2b85a39f38 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:55.792988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f942f-e6f1-4be0-80a6-5f2b85a39f38 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:55.794480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 522/1046] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:23:55.799974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9461b5-ee92-4bf0-90b5-d7c4500a3ab0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:55.800269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9461b5-ee92-4bf0-90b5-d7c4500a3ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:55.800549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9461b5-ee92-4bf0-90b5-d7c4500a3ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:55.819386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4c9461b5-ee92-4bf0-90b5-d7c4500a3ab0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:55.820576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4c9461b5-ee92-4bf0-90b5-d7c4500a3ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:55.886106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 525/1047] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:56.152108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f942f-e6f1-4be0-80a6-5f2b85a39f38 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:56.253617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f942f-e6f1-4be0-80a6-5f2b85a39f38 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:56.265504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:56.293279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:56.293912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:56.294191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:56.294496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:56.304477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:56.309310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:56.311004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:56.311846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:56.313082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 523/1048] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:56.317115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9461b5-ee92-4bf0-90b5-d7c4500a3ab0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:56.342830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:56.418231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9461b5-ee92-4bf0-90b5-d7c4500a3ab0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:56.456603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:56.457215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:56.457491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:56.457767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:56.458525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:56.458830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:56.460191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:56.473408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 526/1049] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:56.474716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:56.572445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b207667-3c44-4f28-9118-9033ebf5029c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:56.606503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:56.607132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:56.607433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:56.607707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] PATH_INFO: `/v3/users/c2a3fc8a30ff4fb594bc4b04661eb444` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:56.620719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a3fc8a30ff4fb594bc4b04661eb444)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:56.622150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:56.629895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 524/1050] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:23:56 2022] GET /identity/v3/users/c2a3fc8a30ff4fb594bc4b04661eb444 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:56.630053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:56.720909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:56.736728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37417-c5f0-4ea1-8706-70065514b620 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:56.770191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e73de0-4fbb-405e-9271-3fbdd63d2468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:56.770844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73de0-4fbb-405e-9271-3fbdd63d2468 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:56.771124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73de0-4fbb-405e-9271-3fbdd63d2468 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:56.771396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73de0-4fbb-405e-9271-3fbdd63d2468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:56.839282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e73de0-4fbb-405e-9271-3fbdd63d2468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:56.840765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e73de0-4fbb-405e-9271-3fbdd63d2468 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:56.926178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:56.943827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 527/1051] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:23:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:23:56.949455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:56.965371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35292-0664-440b-a056-96b53e329f9c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:56.965660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35292-0664-440b-a056-96b53e329f9c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:56.965939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35292-0664-440b-a056-96b53e329f9c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:56.967310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 528/1052] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:56.972648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e6a02-b518-4a12-b977-689b7f04b0d3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:56.972880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e6a02-b518-4a12-b977-689b7f04b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:56.973160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e6a02-b518-4a12-b977-689b7f04b0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:56.977993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:56.992881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c57e6a02-b518-4a12-b977-689b7f04b0d3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:56.994214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c57e6a02-b518-4a12-b977-689b7f04b0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:57.056897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bba6d-6d06-4de9-9a40-2765babf14c7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:57.071125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 529/1053] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:57.092422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:57.093060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.093340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.093612 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.094817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] RBAC: Authorizing `identity:get_project(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:57.096197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:57.102586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 525/1054] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:23:56 2022] GET /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:57.104312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e6a02-b518-4a12-b977-689b7f04b0d3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:57.204179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e6a02-b518-4a12-b977-689b7f04b0d3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:57.220781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:57.240395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:57.240938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.241220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.241493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.242218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1, user.id=c2a3fc8a30ff4fb594bc4b04661eb444) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:57.242557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:57.243988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:57.254385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 530/1055] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:23:57 2022] GET /identity/v3/role_assignments?user.id=c2a3fc8a30ff4fb594bc4b04661eb444&scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:57.342761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:57.443715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:57.454615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1debff-f01d-4a79-8183-f7952d679891 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:57.489337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:57.489968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.490244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.490587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] PATH_INFO: `/v3/services/image` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.491115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:57.492481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:57.501204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:57.502162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:57.503123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 526/1056] 10.222.0.52 () {56 vars in 1105 bytes} [Sun Sep 25 04:23:57 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:57.508096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:57.612824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d55c-2856-491c-b993-443de9637dfe None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:57.648845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60c2c-eb02-407e-b05b-c4e5427c54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:57.649459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60c2c-eb02-407e-b05b-c4e5427c54c2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.649741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60c2c-eb02-407e-b05b-c4e5427c54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.650012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60c2c-eb02-407e-b05b-c4e5427c54c2 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.650673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60c2c-eb02-407e-b05b-c4e5427c54c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:57.650979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60c2c-eb02-407e-b05b-c4e5427c54c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:57.652351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60c2c-eb02-407e-b05b-c4e5427c54c2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:57.657776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 531/1057] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:57.663249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:57.721209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abab284-0fa3-4dc3-a1ea-68aee23cdfde None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.721494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abab284-0fa3-4dc3-a1ea-68aee23cdfde None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.721769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abab284-0fa3-4dc3-a1ea-68aee23cdfde None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.723132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 532/1058] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:57.728011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608f5d-7f95-4626-8713-beda87d2f685 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.728290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608f5d-7f95-4626-8713-beda87d2f685 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.728586 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608f5d-7f95-4626-8713-beda87d2f685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.747233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9b608f5d-7f95-4626-8713-beda87d2f685 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:57.748386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9b608f5d-7f95-4626-8713-beda87d2f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:57.771162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab780a39-1a66-4d8a-939d-edbe5eca6c57 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:57.790646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:57.806761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:57.807376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.807657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.807930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.808561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] RBAC: Adding query filter params (type=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:57.808859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:57.811026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:57.815961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 527/1059] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:57.820971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 533/1060] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:23:57.821376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:57.843290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:57.921661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce565fa-e0b5-4d96-81ed-fc1196fee519 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:57.955632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:57.956247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:57.956527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:57.956800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:57.957482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:57.958874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:57.979165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 528/1061] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:23:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:23:58.090036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608f5d-7f95-4626-8713-beda87d2f685 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:58.195629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608f5d-7f95-4626-8713-beda87d2f685 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:58.236133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:58.236766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:58.237040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:58.237308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:58.247516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:58.252310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:58.253239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:58.254091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 534/1062] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Sep 25 04:23:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:58.262515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:58.343510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:58.369093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d8b68-98d1-48d6-8a48-c35939ab17be None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:58.403425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:58.404061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:58.404348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:58.404620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:58.405283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:58.405587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:58.406981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:58.419460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 529/1063] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Sep 25 04:23:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:58.420784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:58.452788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:58.524884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3db5-aeff-41e9-b96a-49f2cf3d4520 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:58.557824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:58.558535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:58.558813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:58.559081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:58.569742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:58.571234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:58.585944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:58.586905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:58.587821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:58.587821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:58.587821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:58.590662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 535/1064] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:58.592804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:58.695508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599aa3-7dd9-448b-8fce-7bbb1cf5f319 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:58.728327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:58.728943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:58.729222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:58.729496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:58.730134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:58.730461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:58.731832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:58.739426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:58.750450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 530/1065] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:23:58.752083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:58.835575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:58.854774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123ba1f-99ae-4524-9cdb-b5b3ca50a8e8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:58.888245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:58.888943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:58.889221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:58.889493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:58.898213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:58.899744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:23:58.911994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:58.912998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:58.918788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 536/1066] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:23:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:58.919476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.022008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ef128-70c8-4444-8a05-475a9bbe0056 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:59.054890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:59.055499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.055779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.056053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.056777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:59.057081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:59.058548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:59.081142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 531/1067] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:23:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:59.082651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.186275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824547-533f-4187-ad16-4ead861c4009 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:59.219393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33086-bea0-4f54-ab02-88dbb43805ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:59.220024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33086-bea0-4f54-ab02-88dbb43805ce None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.220307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33086-bea0-4f54-ab02-88dbb43805ce None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.220579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33086-bea0-4f54-ab02-88dbb43805ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.232077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33086-bea0-4f54-ab02-88dbb43805ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:59.233545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33086-bea0-4f54-ab02-88dbb43805ce None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:59.235335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-80c33086-bea0-4f54-ab02-88dbb43805ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:23:59.249682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:59.250862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:23:59.251752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:23:59.251752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:23:59.251752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:59.257340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.257491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 537/1068] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:23:59.322988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:59.368428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a449cb-cb63-45c9-a745-9316b2bb65c8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:59.401248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:59.401852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.402126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.402416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.403047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:59.403344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:59.405217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:59.410683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bff0-e7ca-4fa5-8ecf-97a852f03fa4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.410971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bff0-e7ca-4fa5-8ecf-97a852f03fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.411244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bff0-e7ca-4fa5-8ecf-97a852f03fa4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.412730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 538/1069] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:23:59.421643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 532/1070] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:59.421814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568ddf-d953-48c8-95d8-e8b5691d0993 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.421814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568ddf-d953-48c8-95d8-e8b5691d0993 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.421814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568ddf-d953-48c8-95d8-e8b5691d0993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.422714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.438821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-38568ddf-d953-48c8-95d8-e8b5691d0993 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:23:59.440045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-38568ddf-d953-48c8-95d8-e8b5691d0993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:23:59.511388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 539/1071] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:23:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:23:59.532061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f08ed-1780-4083-9443-ae4d35dd1698 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:59.548222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:59.567117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:59.567749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.568029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.568303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.575136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:59.577172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:23:59.588611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:59.589465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:23:59.595480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 533/1072] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:23:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:59.596059 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568ddf-d953-48c8-95d8-e8b5691d0993 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.698165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568ddf-d953-48c8-95d8-e8b5691d0993 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:59.721982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:23:59.733784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:59.734432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.734715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.734989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.735682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:23:59.735987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:59.737416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:59.754457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 540/1073] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:23:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:23:59.755966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.780411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.864580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248149-af6e-44dc-8fc9-5384259ca44a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:59.885048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f400f-6c35-4c29-91a1-b2731e32294f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:23:59.899030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:59.900037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.900385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.900777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/079636b6d56943928420801c47555aea/roles/9e75c2c3089d4100bc098bf0beb85827` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.903914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=079636b6d56943928420801c47555aea, role_id=9e75c2c3089d4100bc098bf0beb85827)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:23:59.906311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:23:59.920674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:23:59.921350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:23:59.921630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:23:59.922099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 534/1074] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:23:59 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/079636b6d56943928420801c47555aea/roles/9e75c2c3089d4100bc098bf0beb85827 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:23:59.922503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:23:59.935413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:23:59.940598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:23:59.941583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:23:59.943296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 541/1075] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:23:59.948327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:23:59.987786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:00.062414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fa88-34af-418b-b05f-604cc532e9fa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:00.106756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998ad72-04e8-4081-b172-a86ac376815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:00.107988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998ad72-04e8-4081-b172-a86ac376815a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:00.108337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998ad72-04e8-4081-b172-a86ac376815a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:00.108622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998ad72-04e8-4081-b172-a86ac376815a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:00.109306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998ad72-04e8-4081-b172-a86ac376815a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:00.109614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998ad72-04e8-4081-b172-a86ac376815a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:00.111056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998ad72-04e8-4081-b172-a86ac376815a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:00.121111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 535/1076] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:00.127282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:00.174657 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:00.198111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0bb3b-6304-4aae-bffd-8236e4855188 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:00.198591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0bb3b-6304-4aae-bffd-8236e4855188 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:00.198873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0bb3b-6304-4aae-bffd-8236e4855188 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:00.200460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 536/1077] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:00.206966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b87b-f1cd-48d3-8bbf-91c47de6ccf1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:00.207250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b87b-f1cd-48d3-8bbf-91c47de6ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:00.207526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b87b-f1cd-48d3-8bbf-91c47de6ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:00.225599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0120b87b-f1cd-48d3-8bbf-91c47de6ccf1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:00.226926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0120b87b-f1cd-48d3-8bbf-91c47de6ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:00.233497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80044844-0708-4ba7-8aa1-60fe865c4296 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:00.270651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:00.271296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:00.271578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:00.271854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] PATH_INFO: `/v3/users/c2a3fc8a30ff4fb594bc4b04661eb444` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:00.272990 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a3fc8a30ff4fb594bc4b04661eb444)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:00.274463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:00.276217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 542/1078] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:00 2022] GET /identity/v3/users/c2a3fc8a30ff4fb594bc4b04661eb444 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:00.281658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:00.309224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 537/1079] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:24:00.385758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214158d0-6a0c-4c0b-9e11-c537a2dab3b3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:00.399715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:00.422330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:00.423084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:00.423367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:00.423640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:00.424745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] RBAC: Authorizing `identity:get_project(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:00.426171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:00.427982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 543/1080] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:00 2022] GET /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:00.433636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b87b-f1cd-48d3-8bbf-91c47de6ccf1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:00.463247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:00.537269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b87b-f1cd-48d3-8bbf-91c47de6ccf1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:00.571266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:00.571927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:00.572207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:00.572478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1/users/c2a3fc8a30ff4fb594bc4b04661eb444/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:00.574383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] RBAC: Authorizing `identity:create_grant(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1, user_id=c2a3fc8a30ff4fb594bc4b04661eb444, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:00.575846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:00.581988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:00.590495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 538/1081] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:24:00 2022] PUT /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1/users/c2a3fc8a30ff4fb594bc4b04661eb444/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:24:00.696606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457b08-7144-443d-94d4-538bb2f30c98 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:00.733275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:00.733895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:00.734175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:00.734476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:00.790115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:00.813551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:00.815072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:00.918394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 544/1082] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:00.921072 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:01.008576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:01.024033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992485d-c779-4e28-bbfc-b2aa0e34128e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:01.058664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b35e5-e46c-4bbc-a545-170e562a9f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:01.059388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b35e5-e46c-4bbc-a545-170e562a9f39 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:01.059736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b35e5-e46c-4bbc-a545-170e562a9f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:01.060900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b35e5-e46c-4bbc-a545-170e562a9f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:01.072960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b35e5-e46c-4bbc-a545-170e562a9f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:01.074532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b35e5-e46c-4bbc-a545-170e562a9f39 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-015b35e5-e46c-4bbc-a545-170e562a9f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:24:01.089271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:01.090578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:24:01.096691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:24:01.096691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:24:01.096691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:01.096691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 539/1083] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:01.098711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:01.179678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:01.201811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf286a6-cbde-4059-a661-4eadc16fb32f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:01.235926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea19b8-0c4f-44b5-a105-8976b674270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:01.236654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea19b8-0c4f-44b5-a105-8976b674270d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:01.236962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea19b8-0c4f-44b5-a105-8976b674270d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:01.237298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea19b8-0c4f-44b5-a105-8976b674270d None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:01.238006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea19b8-0c4f-44b5-a105-8976b674270d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:01.238400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea19b8-0c4f-44b5-a105-8976b674270d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:01.239826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea19b8-0c4f-44b5-a105-8976b674270d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:01.258396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 545/1084] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:02.067158 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e9da-0a30-41c1-8e7e-d57ebfbff6dc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:02.067683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e9da-0a30-41c1-8e7e-d57ebfbff6dc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:02.067683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e9da-0a30-41c1-8e7e-d57ebfbff6dc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:02.069025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 540/1085] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:02.074398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815780-0aea-46a0-8846-ac684ad9b9aa None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:02.074696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815780-0aea-46a0-8846-ac684ad9b9aa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:02.074977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815780-0aea-46a0-8846-ac684ad9b9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:02.093725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-19815780-0aea-46a0-8846-ac684ad9b9aa None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:02.094973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-19815780-0aea-46a0-8846-ac684ad9b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:02.159565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 546/1086] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:02.424931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99e9da-0a30-41c1-8e7e-d57ebfbff6dc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:02.531251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99e9da-0a30-41c1-8e7e-d57ebfbff6dc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:02.565096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:02.565731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:02.566012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:02.566285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:02.573667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:02.578044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:02.583085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:02.584206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:02.585103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 541/1087] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Sep 25 04:24:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:02.590160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815780-0aea-46a0-8846-ac684ad9b9aa None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:02.661303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:02.692554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815780-0aea-46a0-8846-ac684ad9b9aa None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:02.725675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739d761-039c-44b8-80b7-3ffa1f894e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:02.726305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d761-039c-44b8-80b7-3ffa1f894e56 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:02.726620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d761-039c-44b8-80b7-3ffa1f894e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:02.726894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d761-039c-44b8-80b7-3ffa1f894e56 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:02.727554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739d761-039c-44b8-80b7-3ffa1f894e56 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:02.727857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739d761-039c-44b8-80b7-3ffa1f894e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:02.729225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739d761-039c-44b8-80b7-3ffa1f894e56 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:02.737518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 547/1088] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Sep 25 04:24:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:02.743353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:02.746834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f99294-6dd7-4df7-a7f3-4589fda855e3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:02.747125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f99294-6dd7-4df7-a7f3-4589fda855e3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:02.747396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f99294-6dd7-4df7-a7f3-4589fda855e3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:02.749306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 548/1089] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:24:02.754190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54192baf-cccd-4d6a-9376-316f787f024b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:02.754507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54192baf-cccd-4d6a-9376-316f787f024b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:02.754786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54192baf-cccd-4d6a-9376-316f787f024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:02.772204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-54192baf-cccd-4d6a-9376-316f787f024b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:02.773383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-54192baf-cccd-4d6a-9376-316f787f024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:02.838318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 549/1090] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:24:02.846821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e2a8-4970-4b78-87e8-c754dffabca0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:02.879779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:02.880399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:02.880677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:02.880948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:02.891159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:02.892593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:24:02.906906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:02.908042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:24:02.909405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:24:02.909405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:24:02.909405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:02.909405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 542/1091] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:02.913611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54192baf-cccd-4d6a-9376-316f787f024b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:02.973507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.010699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54192baf-cccd-4d6a-9376-316f787f024b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.042891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.043486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.043761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.044030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.044688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:03.044985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.046335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.057072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 550/1092] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:03.063406 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.105811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.114594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.162018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782186e-c1b6-4207-bcfd-80011758cfb4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.197750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.198444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.198728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.199013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.204560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc53aa-49e0-4364-a0b1-bd967d4e9abf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.206503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.207952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:24:03.219063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:03.220232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:03.221208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 543/1093] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:03.225852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.231348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.244609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.245251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.245533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.245806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.257132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:03.262022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:03.262994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:24:03.267293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 551/1094] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:24:03.269208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.326097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8bc7-4611-4d8b-8a23-0811eaff39e8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.338862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.361998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.362637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.362918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.363196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.363926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:03.364235 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.365664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.366917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c94345-4f94-46f1-921f-257fe28240d0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.382193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 544/1095] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:03.387851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.400947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.401552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.401832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.402102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.402813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:03.403114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.405032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.414387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 552/1096] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:03.419185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.463769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.490478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4313b3-9f48-4c2d-b6ab-e05956b621cb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.519536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f93e-02ca-482d-bfbd-f5c655ce9748 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.524042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.524658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.524941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.525215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.554755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.555384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.555668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.555943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] PATH_INFO: `/v3/users/c2a3fc8a30ff4fb594bc4b04661eb444` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.557101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a3fc8a30ff4fb594bc4b04661eb444)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.558568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.565777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 553/1097] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/users/c2a3fc8a30ff4fb594bc4b04661eb444 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:03.565911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.567096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.594909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.596364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.664407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6243621-f9aa-46cc-849e-33a3d02f0a60 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.678254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.695009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 545/1098] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 04:24:03.700667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.700854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.701405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.701682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.701953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.767140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.769241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.770732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.799037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19da6b2-ca18-47f9-a567-c4aa11ccb251 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.832116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.832744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:03.833025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:03.833300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:03.843632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:03.845072 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:24:03.859424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:03.860553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:24:03.861778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:24:03.861778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:24:03.861778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:03.861778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 546/1099] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:24:03.866157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.875668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 554/1100] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:03.876655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:03.889746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.965066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276df2e2-a2f0-444c-b98b-435c4596a862 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.976596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81d68-bd9c-42c1-8600-679cd3243ffd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:03.986920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:03.999379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:03.999988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:04.000274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:04.000550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:04.001194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:04.001502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:04.002918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:04.011449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:04.012084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:04.012361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:04.012642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:04.014281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] RBAC: Authorizing `identity:get_project(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:04.015794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:04.017348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 547/1101] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:04.017484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 555/1102] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:03 2022] GET /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:04.024376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:04.029555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:04.107904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:04.126554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9a739-7858-4892-be93-b3d730e15980 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:04.127063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ff95-bb8c-4686-a0b5-8b6d527aee42 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:04.158784 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:04.159265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:04.159405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:04.159683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:04.159861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:04.159961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:04.160144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:04.160416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:04.161133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1, user.id=c2a3fc8a30ff4fb594bc4b04661eb444) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:04.161437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:04.162891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:04.166443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:04.167863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:04.168490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 556/1103] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:04 2022] GET /identity/v3/role_assignments?user.id=c2a3fc8a30ff4fb594bc4b04661eb444&scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:24:04.179675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:04.180842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:24:04.181972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:04.186551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 548/1104] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:04.187924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:04.293863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b44062-bbfa-4f78-9a33-cce4337fd516 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:04.329177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805feaf0-bb09-483c-a5dc-18be52921ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:04.329796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805feaf0-bb09-483c-a5dc-18be52921ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:04.330076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805feaf0-bb09-483c-a5dc-18be52921ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:04.330370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805feaf0-bb09-483c-a5dc-18be52921ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:04.331083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805feaf0-bb09-483c-a5dc-18be52921ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:04.331395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805feaf0-bb09-483c-a5dc-18be52921ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:04.332846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805feaf0-bb09-483c-a5dc-18be52921ea0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:04.345993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 557/1105] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:04.352009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:04.397511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:04.453661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517155-e840-4e69-aedf-629150ffe1da None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:04.487474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca72a-caa4-4d18-b6c8-5d80ee46bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:04.488078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca72a-caa4-4d18-b6c8-5d80ee46bd2f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:04.488362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca72a-caa4-4d18-b6c8-5d80ee46bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:04.488635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca72a-caa4-4d18-b6c8-5d80ee46bd2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:04.489418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca72a-caa4-4d18-b6c8-5d80ee46bd2f None admin] RBAC: Adding query filter params (role.id=9e75c2c3089d4100bc098bf0beb85827, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=079636b6d56943928420801c47555aea) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:04.489731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca72a-caa4-4d18-b6c8-5d80ee46bd2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:04.491190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca72a-caa4-4d18-b6c8-5d80ee46bd2f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:04.497033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 549/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:04 2022] GET /identity/v3/role_assignments?user.id=079636b6d56943928420801c47555aea&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=9e75c2c3089d4100bc098bf0beb85827 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:06.351487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ead66-2fbc-4c90-91b2-0480db24fe52 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:06.351996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ead66-2fbc-4c90-91b2-0480db24fe52 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:06.352108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ead66-2fbc-4c90-91b2-0480db24fe52 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:06.353371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 558/1107] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:06.359153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118cb3a-e5fb-46bc-8b53-a4b7bb035cda None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:06.359545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118cb3a-e5fb-46bc-8b53-a4b7bb035cda None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:06.359706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118cb3a-e5fb-46bc-8b53-a4b7bb035cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:06.379661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8118cb3a-e5fb-46bc-8b53-a4b7bb035cda None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:06.380873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8118cb3a-e5fb-46bc-8b53-a4b7bb035cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:06.444882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 550/1108] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:06.713440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ead66-2fbc-4c90-91b2-0480db24fe52 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:06.718029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:06.812753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ead66-2fbc-4c90-91b2-0480db24fe52 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:06.845860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938d64f-65ec-495d-888d-c22cb3461236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:06.846508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938d64f-65ec-495d-888d-c22cb3461236 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:06.846790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938d64f-65ec-495d-888d-c22cb3461236 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:06.847055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938d64f-65ec-495d-888d-c22cb3461236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:06.848164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938d64f-65ec-495d-888d-c22cb3461236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:06.849596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938d64f-65ec-495d-888d-c22cb3461236 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:06.851166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 559/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:06.856811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118cb3a-e5fb-46bc-8b53-a4b7bb035cda None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:06.890233 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:06.954828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118cb3a-e5fb-46bc-8b53-a4b7bb035cda None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:06.987753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baf6e2-ba6f-4b74-9402-cd398b9ab220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:06.988301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baf6e2-ba6f-4b74-9402-cd398b9ab220 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:06.988582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baf6e2-ba6f-4b74-9402-cd398b9ab220 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:06.988855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baf6e2-ba6f-4b74-9402-cd398b9ab220 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:06.989499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99baf6e2-ba6f-4b74-9402-cd398b9ab220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:06.990958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99baf6e2-ba6f-4b74-9402-cd398b9ab220 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:07.011510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 551/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:24:06 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:24:09.209422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2263-d5b3-482a-80f5-bde2f7bec17a None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:09.209974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2263-d5b3-482a-80f5-bde2f7bec17a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:09.209974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2263-d5b3-482a-80f5-bde2f7bec17a None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:09.211328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 560/1111] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:09.216511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94919512-a0b0-49ab-affb-8d764d4d55bf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:09.216927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94919512-a0b0-49ab-affb-8d764d4d55bf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:09.217071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94919512-a0b0-49ab-affb-8d764d4d55bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:09.236530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-94919512-a0b0-49ab-affb-8d764d4d55bf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:09.237717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-94919512-a0b0-49ab-affb-8d764d4d55bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:09.301528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 552/1112] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:09.573795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d2263-d5b3-482a-80f5-bde2f7bec17a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:09.642434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:09.672655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d2263-d5b3-482a-80f5-bde2f7bec17a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:09.705368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:09.705986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:09.706265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:09.706637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] PATH_INFO: `/v3/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:09.708023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] RBAC: Authorizing `identity:get_role(role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:09.709386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:09.710718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 561/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:09 2022] GET /identity/v3/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:09.716936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94919512-a0b0-49ab-affb-8d764d4d55bf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:09.740129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:09.813822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94919512-a0b0-49ab-affb-8d764d4d55bf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:09.846741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:09.847300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:09.847578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:09.847849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] PATH_INFO: `/v3/users/56fcc9d7f3ab4bedb5ea2140e59c44c3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:09.860193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] RBAC: Authorizing `identity:get_user(user_id=56fcc9d7f3ab4bedb5ea2140e59c44c3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:09.861629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:09.863226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 553/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:09 2022] GET /identity/v3/users/56fcc9d7f3ab4bedb5ea2140e59c44c3 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:09.868765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:09.965667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc397-7bc6-4f4f-b0ed-a590ccf6a878 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:09.998010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:09.998632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:09.998913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:09.999187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:10.008885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:10.064601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:10.066109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:10.158979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 562/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:10.164887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:10.241848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:10.261515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d0769-7567-43f9-a47a-7b9010615bdb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:10.294916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f699a-e628-4504-90c9-fd89d62a5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:10.295536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f699a-e628-4504-90c9-fd89d62a5235 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:10.295812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f699a-e628-4504-90c9-fd89d62a5235 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:10.296083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f699a-e628-4504-90c9-fd89d62a5235 None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:10.297187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f699a-e628-4504-90c9-fd89d62a5235 None admin] RBAC: Authorizing `identity:get_project(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:10.298639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f699a-e628-4504-90c9-fd89d62a5235 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:10.300246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 554/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:10 2022] GET /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:10.306787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:10.346284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:10.401423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0db85-f3ed-478d-83da-f8e31aa16df8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:10.434102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f37e-8cca-4adb-bd2b-04d14daf02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:10.434662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f37e-8cca-4adb-bd2b-04d14daf02e0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:10.435232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f37e-8cca-4adb-bd2b-04d14daf02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:10.435506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f37e-8cca-4adb-bd2b-04d14daf02e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:10.436214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f37e-8cca-4adb-bd2b-04d14daf02e0 None admin] RBAC: Adding query filter params (role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1, user.id=56fcc9d7f3ab4bedb5ea2140e59c44c3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:10.436518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f37e-8cca-4adb-bd2b-04d14daf02e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:10.437925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f37e-8cca-4adb-bd2b-04d14daf02e0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:10.443069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 563/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:10 2022] GET /identity/v3/role_assignments?user.id=56fcc9d7f3ab4bedb5ea2140e59c44c3&scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:12.508223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ed1d-4fc7-4880-94c7-73cc63d45bbe None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:12.508741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ed1d-4fc7-4880-94c7-73cc63d45bbe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:12.508741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ed1d-4fc7-4880-94c7-73cc63d45bbe None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:12.510147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 555/1118] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:12.515298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67599-1a14-4368-8e8c-9e098aa1e084 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:12.515714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67599-1a14-4368-8e8c-9e098aa1e084 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:12.515858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67599-1a14-4368-8e8c-9e098aa1e084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:12.533996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8df67599-1a14-4368-8e8c-9e098aa1e084 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:12.535221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8df67599-1a14-4368-8e8c-9e098aa1e084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:12.599509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 564/1119] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:12.864255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573ed1d-4fc7-4880-94c7-73cc63d45bbe None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:12.960595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573ed1d-4fc7-4880-94c7-73cc63d45bbe None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:12.993307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:12.993916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:12.994192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:12.994490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] PATH_INFO: `/v3/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:12.995865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] RBAC: Authorizing `identity:get_role(role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:12.997220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:12.998527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 556/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:12 2022] GET /identity/v3/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:13.004061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67599-1a14-4368-8e8c-9e098aa1e084 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:13.036619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:13.100320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67599-1a14-4368-8e8c-9e098aa1e084 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:13.131892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:13.132507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:13.132785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:13.133054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] PATH_INFO: `/v3/users/56fcc9d7f3ab4bedb5ea2140e59c44c3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:13.134150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] RBAC: Authorizing `identity:get_user(user_id=56fcc9d7f3ab4bedb5ea2140e59c44c3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:13.135600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:13.137137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 565/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:13 2022] GET /identity/v3/users/56fcc9d7f3ab4bedb5ea2140e59c44c3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:13.143286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:13.161637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:13.242041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112b73-2aff-455c-b9f9-549eaf579e1a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:13.278042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238e376-1bb6-4f2a-85de-67f25326b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:13.279335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238e376-1bb6-4f2a-85de-67f25326b36b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:13.279611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238e376-1bb6-4f2a-85de-67f25326b36b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:13.279880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238e376-1bb6-4f2a-85de-67f25326b36b None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:13.280998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238e376-1bb6-4f2a-85de-67f25326b36b None admin] RBAC: Authorizing `identity:get_project(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:13.282460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238e376-1bb6-4f2a-85de-67f25326b36b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:13.284081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 557/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:13 2022] GET /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:13.289875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:13.383799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f015a-c921-4700-a4aa-f70629e69c96 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:13.385216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:13.416372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee8265-df83-42e6-8043-0157bee24cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:13.417012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8265-df83-42e6-8043-0157bee24cec None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:13.417289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8265-df83-42e6-8043-0157bee24cec None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:13.417559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8265-df83-42e6-8043-0157bee24cec None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1/users/56fcc9d7f3ab4bedb5ea2140e59c44c3/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:13.419685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8265-df83-42e6-8043-0157bee24cec None admin] RBAC: Authorizing `identity:create_grant(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1, user_id=56fcc9d7f3ab4bedb5ea2140e59c44c3, role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:13.421111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8265-df83-42e6-8043-0157bee24cec None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:13.432803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 566/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:24:13 2022] PUT /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1/users/56fcc9d7f3ab4bedb5ea2140e59c44c3/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:24:15.516147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c295-2606-4cb1-bae8-4a78cb92d6ad None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:15.516660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c295-2606-4cb1-bae8-4a78cb92d6ad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:15.516660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c295-2606-4cb1-bae8-4a78cb92d6ad None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:15.517939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 558/1124] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:15.523024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7925-6655-4877-bd0c-25e637bfb76f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:15.523391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7925-6655-4877-bd0c-25e637bfb76f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:15.523568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7925-6655-4877-bd0c-25e637bfb76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:15.541684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-421d7925-6655-4877-bd0c-25e637bfb76f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:15.542888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-421d7925-6655-4877-bd0c-25e637bfb76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:15.606212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 567/1125] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:15.870570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269c295-2606-4cb1-bae8-4a78cb92d6ad None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:15.952982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:15.969147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269c295-2606-4cb1-bae8-4a78cb92d6ad None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:16.001945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:16.002584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:16.002865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:16.003140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] PATH_INFO: `/v3/roles/acdb8cddb4694eb7ba2e74675d0bb349` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:16.004519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] RBAC: Authorizing `identity:get_role(role_id=acdb8cddb4694eb7ba2e74675d0bb349)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:16.005886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:16.007214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 559/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:15 2022] GET /identity/v3/roles/acdb8cddb4694eb7ba2e74675d0bb349 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:16.012970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7925-6655-4877-bd0c-25e637bfb76f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:16.098130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:16.108201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7925-6655-4877-bd0c-25e637bfb76f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:16.140779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:16.141344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:16.141623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:16.141897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] PATH_INFO: `/v3/users/56fcc9d7f3ab4bedb5ea2140e59c44c3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:16.143027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] RBAC: Authorizing `identity:get_user(user_id=56fcc9d7f3ab4bedb5ea2140e59c44c3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:16.144475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:16.146081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 568/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:16 2022] GET /identity/v3/users/56fcc9d7f3ab4bedb5ea2140e59c44c3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:16.151953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:16.248805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e9408-8735-41f8-8c8b-0840bc75fe2d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:16.283305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:16.283906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:16.284188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:16.284462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:16.304675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:16.350088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:16.351558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:16.447274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 560/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:16.453659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:16.548009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f05da3-f30e-409e-8cd8-53a73be55dbf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:16.580933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3efa6c-09a9-4dd7-8b5b-10124ae808e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:16.581547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3efa6c-09a9-4dd7-8b5b-10124ae808e5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:16.581830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3efa6c-09a9-4dd7-8b5b-10124ae808e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:16.582099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3efa6c-09a9-4dd7-8b5b-10124ae808e5 None admin] PATH_INFO: `/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:16.583225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3efa6c-09a9-4dd7-8b5b-10124ae808e5 None admin] RBAC: Authorizing `identity:get_project(project_id=cce594e2a4bc40a2a97afb7bdc9bd2d1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:16.584636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3efa6c-09a9-4dd7-8b5b-10124ae808e5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:16.586216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 569/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:16 2022] GET /identity/v3/projects/cce594e2a4bc40a2a97afb7bdc9bd2d1 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:16.592790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:16.643263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:16.689551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f942cb7-f78c-47ed-9b42-6682ef23333f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:16.722560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f684-45e4-4ba2-9e26-936cccfa84f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:16.723094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f684-45e4-4ba2-9e26-936cccfa84f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:16.723376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f684-45e4-4ba2-9e26-936cccfa84f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:16.723644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f684-45e4-4ba2-9e26-936cccfa84f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:16.724350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9f684-45e4-4ba2-9e26-936cccfa84f4 None admin] RBAC: Adding query filter params (role.id=acdb8cddb4694eb7ba2e74675d0bb349, scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1, user.id=56fcc9d7f3ab4bedb5ea2140e59c44c3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:16.724653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9f684-45e4-4ba2-9e26-936cccfa84f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:16.726063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9f684-45e4-4ba2-9e26-936cccfa84f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:16.731674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 561/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:16 2022] GET /identity/v3/role_assignments?user.id=56fcc9d7f3ab4bedb5ea2140e59c44c3&scope.project.id=cce594e2a4bc40a2a97afb7bdc9bd2d1&role.id=acdb8cddb4694eb7ba2e74675d0bb349 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:18.893398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62496ac-ae7e-4aab-ac6c-c496a9a641a1 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:18.893923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62496ac-ae7e-4aab-ac6c-c496a9a641a1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:18.893923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62496ac-ae7e-4aab-ac6c-c496a9a641a1 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:18.895322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 570/1131] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:18.900570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7b085-fdcd-43ce-9a37-6ab2f3db1f69 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:18.901095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7b085-fdcd-43ce-9a37-6ab2f3db1f69 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:18.901531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7b085-fdcd-43ce-9a37-6ab2f3db1f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:18.921308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d0c7b085-fdcd-43ce-9a37-6ab2f3db1f69 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:18.922590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d0c7b085-fdcd-43ce-9a37-6ab2f3db1f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:18.986921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 562/1132] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:19.253661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62496ac-ae7e-4aab-ac6c-c496a9a641a1 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:19.282233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:19.354008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62496ac-ae7e-4aab-ac6c-c496a9a641a1 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:19.386947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee5163-d587-4f59-aca2-eb209d32bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:19.387571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee5163-d587-4f59-aca2-eb209d32bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:19.388442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee5163-d587-4f59-aca2-eb209d32bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:19.388721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee5163-d587-4f59-aca2-eb209d32bcb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:19.389837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee5163-d587-4f59-aca2-eb209d32bcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:19.391310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee5163-d587-4f59-aca2-eb209d32bcb6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:19.392875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 571/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:19.398806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7b085-fdcd-43ce-9a37-6ab2f3db1f69 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:19.443765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:19.495329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7b085-fdcd-43ce-9a37-6ab2f3db1f69 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:19.529004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260115f1-624e-4746-b041-7b40987ad05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:19.529537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260115f1-624e-4746-b041-7b40987ad05c None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:19.529813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260115f1-624e-4746-b041-7b40987ad05c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:19.530080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260115f1-624e-4746-b041-7b40987ad05c None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:19.530756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260115f1-624e-4746-b041-7b40987ad05c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:19.532179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260115f1-624e-4746-b041-7b40987ad05c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:19.558419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 563/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:24:19 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:24:21.698711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b97202-4e75-4dbe-aeab-0ce5b1849f75 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:21.699240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b97202-4e75-4dbe-aeab-0ce5b1849f75 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:21.699240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b97202-4e75-4dbe-aeab-0ce5b1849f75 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:21.701149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 572/1135] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:21.706316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e079034-8a21-4d20-9ae6-a5d198f32189 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:21.706748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e079034-8a21-4d20-9ae6-a5d198f32189 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:21.706917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e079034-8a21-4d20-9ae6-a5d198f32189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:21.725373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4e079034-8a21-4d20-9ae6-a5d198f32189 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:21.726606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4e079034-8a21-4d20-9ae6-a5d198f32189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:21.790240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 564/1136] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:22.060413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b97202-4e75-4dbe-aeab-0ce5b1849f75 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:22.150607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:22.157318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b97202-4e75-4dbe-aeab-0ce5b1849f75 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:22.190493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab45cbc-c830-4a7c-a165-a80638c48544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:22.191105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab45cbc-c830-4a7c-a165-a80638c48544 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:22.191380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab45cbc-c830-4a7c-a165-a80638c48544 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:22.191645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab45cbc-c830-4a7c-a165-a80638c48544 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:22.192744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab45cbc-c830-4a7c-a165-a80638c48544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:22.194158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab45cbc-c830-4a7c-a165-a80638c48544 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:22.195723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 573/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:22.201379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e079034-8a21-4d20-9ae6-a5d198f32189 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:22.227797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:22.301235 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e079034-8a21-4d20-9ae6-a5d198f32189 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:22.333706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1295d48-ed0a-4b5f-b664-3cf1bdf4a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:22.334253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1295d48-ed0a-4b5f-b664-3cf1bdf4a988 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:22.334560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1295d48-ed0a-4b5f-b664-3cf1bdf4a988 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:22.334836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1295d48-ed0a-4b5f-b664-3cf1bdf4a988 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:22.335493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1295d48-ed0a-4b5f-b664-3cf1bdf4a988 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:22.336922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1295d48-ed0a-4b5f-b664-3cf1bdf4a988 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:22.358701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 565/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:24:22 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:24:24.557379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26977c-f32c-4625-ba63-8853ef9b3c58 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:24.557873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26977c-f32c-4625-ba63-8853ef9b3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:24.557873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26977c-f32c-4625-ba63-8853ef9b3c58 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:24.559739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 574/1139] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:24.565115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb936f0-8c9a-4004-90ad-01971b634fca None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:24.565480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb936f0-8c9a-4004-90ad-01971b634fca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:24.565671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb936f0-8c9a-4004-90ad-01971b634fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:24.583967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5bb936f0-8c9a-4004-90ad-01971b634fca None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:24.585166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5bb936f0-8c9a-4004-90ad-01971b634fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:24.648824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 566/1140] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:24.915927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26977c-f32c-4625-ba63-8853ef9b3c58 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:25.014364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26977c-f32c-4625-ba63-8853ef9b3c58 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:25.046582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:25.047194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:25.047473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:25.047743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:25.057449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:25.062582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:25.063530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:24:25.064565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 575/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:25.069457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb936f0-8c9a-4004-90ad-01971b634fca None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:25.084453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:25.167218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb936f0-8c9a-4004-90ad-01971b634fca None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:25.199677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:25.200761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:25.201038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:25.201311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:25.201974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:25.202278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:25.203664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:25.211337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 567/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:25.217785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:25.242942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:25.316270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ea90-8c5b-4a25-a5c8-4f4216f0cfcb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:25.348440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:25.349061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:25.349337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:25.349608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] PATH_INFO: `/v3/users/c4ec7b601a6948b2b498bbe5887777db` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:25.362668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec7b601a6948b2b498bbe5887777db)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:25.364098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:25.365668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 576/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:25 2022] GET /identity/v3/users/c4ec7b601a6948b2b498bbe5887777db => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:25.371439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:25.445285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:25.467578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9dbd-e368-4676-8b5e-e9973a9e6cfc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:25.499782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:25.500374 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:25.500651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:25.500921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:25.564472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:25.565923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:25.637128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:25.661022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 568/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:25.666840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:25.744768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:25.763087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24f4f-bcf2-42cb-ada5-94956b0a9b67 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:25.795667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a2fef-e561-40c8-bf7f-491bbea05634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:25.796286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a2fef-e561-40c8-bf7f-491bbea05634 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:25.796566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a2fef-e561-40c8-bf7f-491bbea05634 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:25.796840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a2fef-e561-40c8-bf7f-491bbea05634 None admin] PATH_INFO: `/v3/projects/a0cb8d4afdf342f7b526059a167c9441` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:25.797937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a2fef-e561-40c8-bf7f-491bbea05634 None admin] RBAC: Authorizing `identity:get_project(project_id=a0cb8d4afdf342f7b526059a167c9441)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:25.799395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a2fef-e561-40c8-bf7f-491bbea05634 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:25.800989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 577/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:25 2022] GET /identity/v3/projects/a0cb8d4afdf342f7b526059a167c9441 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:25.806909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:25.902046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f166-97d8-450e-80a7-dd9609eb96b0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:25.934791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f162fc-3eff-49f8-b99b-8f90930c8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:25.935647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f162fc-3eff-49f8-b99b-8f90930c8e67 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:25.935926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f162fc-3eff-49f8-b99b-8f90930c8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:25.936197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f162fc-3eff-49f8-b99b-8f90930c8e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:25.936916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f162fc-3eff-49f8-b99b-8f90930c8e67 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=a0cb8d4afdf342f7b526059a167c9441, user.id=c4ec7b601a6948b2b498bbe5887777db) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:25.937222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f162fc-3eff-49f8-b99b-8f90930c8e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:25.938680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f162fc-3eff-49f8-b99b-8f90930c8e67 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:25.943878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 569/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:25 2022] GET /identity/v3/role_assignments?user.id=c4ec7b601a6948b2b498bbe5887777db&scope.project.id=a0cb8d4afdf342f7b526059a167c9441&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:28.097025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490e7b0-ee71-4d4a-bf22-a3c6b41836ce None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:28.097549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490e7b0-ee71-4d4a-bf22-a3c6b41836ce None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:28.097549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490e7b0-ee71-4d4a-bf22-a3c6b41836ce None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:28.098942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 578/1147] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:28.103984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a8579-51d8-42ca-9329-81395b7dda63 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:28.104419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a8579-51d8-42ca-9329-81395b7dda63 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:28.104523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a8579-51d8-42ca-9329-81395b7dda63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:28.122363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-283a8579-51d8-42ca-9329-81395b7dda63 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:28.123553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-283a8579-51d8-42ca-9329-81395b7dda63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:28.157017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:28.188442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 570/1148] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:28.456832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490e7b0-ee71-4d4a-bf22-a3c6b41836ce None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:28.554865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490e7b0-ee71-4d4a-bf22-a3c6b41836ce None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:28.587735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:28.588345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:28.588622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:28.588892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:28.598669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:28.603415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:28.604305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:24:28.605133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 579/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:28.610602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a8579-51d8-42ca-9329-81395b7dda63 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:28.706055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a8579-51d8-42ca-9329-81395b7dda63 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:28.738556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:28.739097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:28.739377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:28.739650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:28.740310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:28.740615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:28.741978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:28.750300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 571/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:28.755743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:28.768819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:28.853524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227338-2b3c-48a0-8ef7-180be5301ff8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:28.886792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:28.888028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:28.888510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:28.888993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] PATH_INFO: `/v3/users/c4ec7b601a6948b2b498bbe5887777db` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:28.890883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec7b601a6948b2b498bbe5887777db)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:28.892687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:28.894599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 580/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:28 2022] GET /identity/v3/users/c4ec7b601a6948b2b498bbe5887777db => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:28.900362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:28.931887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:28.999407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a60a9-cd58-4371-a7b2-4969fffb224e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:29.032329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d29e0d-d504-46e0-8cca-d6f7321bf52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:29.032945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29e0d-d504-46e0-8cca-d6f7321bf52b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:29.033221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29e0d-d504-46e0-8cca-d6f7321bf52b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:29.033490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29e0d-d504-46e0-8cca-d6f7321bf52b None admin] PATH_INFO: `/v3/projects/a0cb8d4afdf342f7b526059a167c9441` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:29.034603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d29e0d-d504-46e0-8cca-d6f7321bf52b None admin] RBAC: Authorizing `identity:get_project(project_id=a0cb8d4afdf342f7b526059a167c9441)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:29.036022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d29e0d-d504-46e0-8cca-d6f7321bf52b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:29.037625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 572/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:28 2022] GET /identity/v3/projects/a0cb8d4afdf342f7b526059a167c9441 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:29.043730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:29.119302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:29.141327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0baef-1e70-4f49-84c8-e126b784fdc2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:29.174604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa74bd9-8e16-4314-808a-a92816305ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:29.175250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74bd9-8e16-4314-808a-a92816305ccf None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:29.175530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74bd9-8e16-4314-808a-a92816305ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:29.175804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74bd9-8e16-4314-808a-a92816305ccf None admin] PATH_INFO: `/v3/projects/a0cb8d4afdf342f7b526059a167c9441/users/c4ec7b601a6948b2b498bbe5887777db/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:29.177674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa74bd9-8e16-4314-808a-a92816305ccf None admin] RBAC: Authorizing `identity:create_grant(project_id=a0cb8d4afdf342f7b526059a167c9441, user_id=c4ec7b601a6948b2b498bbe5887777db, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:29.179126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa74bd9-8e16-4314-808a-a92816305ccf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:29.192230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 581/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:24:29 2022] PUT /identity/v3/projects/a0cb8d4afdf342f7b526059a167c9441/users/c4ec7b601a6948b2b498bbe5887777db/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:24:31.295667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8621f-e4b3-4d2f-b12f-6a2d819929a3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:31.296141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8621f-e4b3-4d2f-b12f-6a2d819929a3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:31.296254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8621f-e4b3-4d2f-b12f-6a2d819929a3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:31.297542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 573/1154] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:31.302799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73650a-9bf3-44d3-8249-31760b3b4d12 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:31.303206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73650a-9bf3-44d3-8249-31760b3b4d12 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:31.303355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73650a-9bf3-44d3-8249-31760b3b4d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:31.323132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3f73650a-9bf3-44d3-8249-31760b3b4d12 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:31.324340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3f73650a-9bf3-44d3-8249-31760b3b4d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:31.389514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 582/1155] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:31.653731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8621f-e4b3-4d2f-b12f-6a2d819929a3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:31.748886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:31.753047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8621f-e4b3-4d2f-b12f-6a2d819929a3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:31.785323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:31.785945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:31.786227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:31.786601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:31.797323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:31.802142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:31.803050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:31.804210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 574/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:31.809711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73650a-9bf3-44d3-8249-31760b3b4d12 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:31.873617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:31.908405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73650a-9bf3-44d3-8249-31760b3b4d12 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:31.941050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:31.941673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:31.941954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:31.942228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:31.942937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:31.943243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:31.944602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:31.952851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 583/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:31.958698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:32.055591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4127ef-624b-424a-89d3-1cc594ee7b3c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:32.090913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:32.091545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:32.091826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:32.092101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] PATH_INFO: `/v3/users/c4ec7b601a6948b2b498bbe5887777db` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:32.093234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec7b601a6948b2b498bbe5887777db)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:32.094689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:32.096359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 575/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:31 2022] GET /identity/v3/users/c4ec7b601a6948b2b498bbe5887777db => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:32.102244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:32.202698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a21ddb-6ed0-4685-b3d0-021aecc7ed90 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:32.229490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:32.236262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:32.236869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:32.237144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:32.237413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:32.303915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:32.305371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:32.403320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 584/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:32.409213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:32.437684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:32.506182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb407-7b17-463a-8246-94a872ab6e84 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:32.538881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fcf40-261f-4ebf-8c35-b4480ac58edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:32.539496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcf40-261f-4ebf-8c35-b4480ac58edf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:32.539772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcf40-261f-4ebf-8c35-b4480ac58edf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:32.540041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcf40-261f-4ebf-8c35-b4480ac58edf None admin] PATH_INFO: `/v3/projects/a0cb8d4afdf342f7b526059a167c9441` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:32.541141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fcf40-261f-4ebf-8c35-b4480ac58edf None admin] RBAC: Authorizing `identity:get_project(project_id=a0cb8d4afdf342f7b526059a167c9441)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:32.542587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fcf40-261f-4ebf-8c35-b4480ac58edf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:32.544731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 576/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:32 2022] GET /identity/v3/projects/a0cb8d4afdf342f7b526059a167c9441 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:32.551023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:32.581654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:32.649531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe521-01be-48bf-9e09-e86a8eb54b94 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:32.682325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd7eb3-e41c-403e-96ed-18fca3f15525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:32.682951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7eb3-e41c-403e-96ed-18fca3f15525 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:32.683231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7eb3-e41c-403e-96ed-18fca3f15525 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:32.683504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7eb3-e41c-403e-96ed-18fca3f15525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:32.684304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd7eb3-e41c-403e-96ed-18fca3f15525 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=a0cb8d4afdf342f7b526059a167c9441, user.id=c4ec7b601a6948b2b498bbe5887777db) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:32.684612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd7eb3-e41c-403e-96ed-18fca3f15525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:32.686310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd7eb3-e41c-403e-96ed-18fca3f15525 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:32.692330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 585/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:32 2022] GET /identity/v3/role_assignments?user.id=c4ec7b601a6948b2b498bbe5887777db&scope.project.id=a0cb8d4afdf342f7b526059a167c9441&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:34.832997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a684c78-be25-4df8-b4b0-2b5bca0690cb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:34.833581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a684c78-be25-4df8-b4b0-2b5bca0690cb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:34.833581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a684c78-be25-4df8-b4b0-2b5bca0690cb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:34.834902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 577/1162] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:34.839976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a0c37-e5fb-4f90-a7e6-a9d3490a5763 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:34.840966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a0c37-e5fb-4f90-a7e6-a9d3490a5763 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:34.841116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a0c37-e5fb-4f90-a7e6-a9d3490a5763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:34.860247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f78a0c37-e5fb-4f90-a7e6-a9d3490a5763 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:34.862155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f78a0c37-e5fb-4f90-a7e6-a9d3490a5763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:34.929144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 586/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:35.192219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a684c78-be25-4df8-b4b0-2b5bca0690cb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:35.286178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:35.292963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a684c78-be25-4df8-b4b0-2b5bca0690cb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:35.325549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:35.326144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:35.326450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:35.326724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:35.390080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:35.391545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:35.480388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:35.487609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 578/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:35.493496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a0c37-e5fb-4f90-a7e6-a9d3490a5763 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:35.517056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:35.588078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a0c37-e5fb-4f90-a7e6-a9d3490a5763 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:35.620118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96daad-7a17-481b-8ef0-03f584913012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:35.620727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96daad-7a17-481b-8ef0-03f584913012 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:35.621004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96daad-7a17-481b-8ef0-03f584913012 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:35.621854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96daad-7a17-481b-8ef0-03f584913012 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:35.628233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96daad-7a17-481b-8ef0-03f584913012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:35.629656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96daad-7a17-481b-8ef0-03f584913012 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1e96daad-7a17-481b-8ef0-03f584913012 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:35.640733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:35.642097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:24:35.643343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 587/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:24:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:35.647674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:35.741743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e4f1-f6be-40bd-9ebd-38ea665253b3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:35.773923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef12055-7849-43b8-be11-bc45a73ad5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:35.774533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12055-7849-43b8-be11-bc45a73ad5ba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:35.774810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12055-7849-43b8-be11-bc45a73ad5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:35.775080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12055-7849-43b8-be11-bc45a73ad5ba None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:35.775705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef12055-7849-43b8-be11-bc45a73ad5ba None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:35.776003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef12055-7849-43b8-be11-bc45a73ad5ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:35.777352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef12055-7849-43b8-be11-bc45a73ad5ba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:35.784629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 579/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Sep 25 04:24:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:37.899849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f2a7-06ce-40a4-a8a2-e5fe8803ce96 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:37.900394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f2a7-06ce-40a4-a8a2-e5fe8803ce96 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:37.900394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f2a7-06ce-40a4-a8a2-e5fe8803ce96 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:37.901739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 588/1167] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:37.907077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e14e7-bdba-4397-8882-9a49aff02792 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:37.907504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e14e7-bdba-4397-8882-9a49aff02792 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:37.907654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e14e7-bdba-4397-8882-9a49aff02792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:37.925836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-805e14e7-bdba-4397-8882-9a49aff02792 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:37.927046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-805e14e7-bdba-4397-8882-9a49aff02792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:37.979946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:37.991578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 580/1168] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:38.255588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173f2a7-06ce-40a4-a8a2-e5fe8803ce96 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:38.339407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:38.355698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173f2a7-06ce-40a4-a8a2-e5fe8803ce96 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:38.388522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcc3d6-b033-4c4c-8c12-43d40de1e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:38.389115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcc3d6-b033-4c4c-8c12-43d40de1e69a None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:38.389392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcc3d6-b033-4c4c-8c12-43d40de1e69a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:38.389664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcc3d6-b033-4c4c-8c12-43d40de1e69a None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:38.390329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcc3d6-b033-4c4c-8c12-43d40de1e69a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:38.391713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcc3d6-b033-4c4c-8c12-43d40de1e69a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:38.407453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 589/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Sun Sep 25 04:24:38 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:24:40.579167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35cd5e-d9c1-4177-ac4d-ddc6ff72bd8c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:40.579681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35cd5e-d9c1-4177-ac4d-ddc6ff72bd8c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:40.579681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35cd5e-d9c1-4177-ac4d-ddc6ff72bd8c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:40.581001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 581/1170] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:40.586231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc941d3e-7b66-4da0-a761-27be34dd22ee None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:40.586693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc941d3e-7b66-4da0-a761-27be34dd22ee None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:40.586833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc941d3e-7b66-4da0-a761-27be34dd22ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:40.604549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-cc941d3e-7b66-4da0-a761-27be34dd22ee None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:40.605767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cc941d3e-7b66-4da0-a761-27be34dd22ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:40.670915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 590/1171] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:40.936162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35cd5e-d9c1-4177-ac4d-ddc6ff72bd8c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:41.034691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35cd5e-d9c1-4177-ac4d-ddc6ff72bd8c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:41.067466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda334eb-b1e6-431b-bfaa-9f3927370788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:41.068085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda334eb-b1e6-431b-bfaa-9f3927370788 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:41.068365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda334eb-b1e6-431b-bfaa-9f3927370788 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:41.068640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda334eb-b1e6-431b-bfaa-9f3927370788 None admin] PATH_INFO: `/v3/domains/db0dba7dddc14768af67b9eeb0f941fe` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:41.078594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda334eb-b1e6-431b-bfaa-9f3927370788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=db0dba7dddc14768af67b9eeb0f941fe)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:41.080024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda334eb-b1e6-431b-bfaa-9f3927370788 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:41.081577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 582/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Sun Sep 25 04:24:40 2022] GET /identity/v3/domains/db0dba7dddc14768af67b9eeb0f941fe => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:41.087398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc941d3e-7b66-4da0-a761-27be34dd22ee None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:41.159015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:41.184696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc941d3e-7b66-4da0-a761-27be34dd22ee None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:41.217344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517810bb-64a3-4ab5-b7f9-fcbed21bd88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:41.217883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517810bb-64a3-4ab5-b7f9-fcbed21bd88a None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:41.218160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517810bb-64a3-4ab5-b7f9-fcbed21bd88a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:41.218456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517810bb-64a3-4ab5-b7f9-fcbed21bd88a None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:41.219103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517810bb-64a3-4ab5-b7f9-fcbed21bd88a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:41.220519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517810bb-64a3-4ab5-b7f9-fcbed21bd88a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:41.245612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 591/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:24:41 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:24:43.378043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0b043-786c-4476-9aea-3a2bf591a1c2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:43.378632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0b043-786c-4476-9aea-3a2bf591a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:43.378770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0b043-786c-4476-9aea-3a2bf591a1c2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:43.380125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 583/1174] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:43.385258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726fbf2-d37c-4439-a3b1-00c283a1e236 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:43.385671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726fbf2-d37c-4439-a3b1-00c283a1e236 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:43.385808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726fbf2-d37c-4439-a3b1-00c283a1e236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:43.404268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d726fbf2-d37c-4439-a3b1-00c283a1e236 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:43.405456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d726fbf2-d37c-4439-a3b1-00c283a1e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:43.469653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 592/1175] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:43.740915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0b043-786c-4476-9aea-3a2bf591a1c2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:43.790930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:43.840722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0b043-786c-4476-9aea-3a2bf591a1c2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:43.872997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad40a1-5cd1-4e06-b2a5-d05726a8ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:43.873616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad40a1-5cd1-4e06-b2a5-d05726a8ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:43.873897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad40a1-5cd1-4e06-b2a5-d05726a8ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:43.874170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad40a1-5cd1-4e06-b2a5-d05726a8ecd8 None admin] PATH_INFO: `/v3/domains/db0dba7dddc14768af67b9eeb0f941fe` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:43.875302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad40a1-5cd1-4e06-b2a5-d05726a8ecd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=db0dba7dddc14768af67b9eeb0f941fe)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:43.876730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad40a1-5cd1-4e06-b2a5-d05726a8ecd8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:43.878267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 584/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Sun Sep 25 04:24:43 2022] GET /identity/v3/domains/db0dba7dddc14768af67b9eeb0f941fe => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:43.883897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726fbf2-d37c-4439-a3b1-00c283a1e236 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:43.938020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:43.981456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726fbf2-d37c-4439-a3b1-00c283a1e236 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:44.014178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3f911-3f7b-4e1e-8e92-e3a455bd7c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:44.014747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3f911-3f7b-4e1e-8e92-e3a455bd7c03 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:44.015025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3f911-3f7b-4e1e-8e92-e3a455bd7c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:44.015297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3f911-3f7b-4e1e-8e92-e3a455bd7c03 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:44.015941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3f911-3f7b-4e1e-8e92-e3a455bd7c03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:44.017358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3f911-3f7b-4e1e-8e92-e3a455bd7c03 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:44.037680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 593/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:24:43 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:24:46.187984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4fb74-8eb5-4cce-9935-d4a2e6b0b6a5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:46.188540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4fb74-8eb5-4cce-9935-d4a2e6b0b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:46.188540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4fb74-8eb5-4cce-9935-d4a2e6b0b6a5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:46.189854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 585/1178] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:46.195114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733da63-6d41-4a9e-b58e-e4e04231a0f5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:46.195505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733da63-6d41-4a9e-b58e-e4e04231a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:46.195672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733da63-6d41-4a9e-b58e-e4e04231a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:46.216280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e733da63-6d41-4a9e-b58e-e4e04231a0f5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:46.217463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e733da63-6d41-4a9e-b58e-e4e04231a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:46.281680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 594/1179] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:46.548903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4fb74-8eb5-4cce-9935-d4a2e6b0b6a5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:46.646456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4fb74-8eb5-4cce-9935-d4a2e6b0b6a5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:46.662250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:46.680825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:46.681499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:46.681782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:46.682055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:46.693353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:46.698101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:46.699249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:46.700138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 586/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:24:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:46.705356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733da63-6d41-4a9e-b58e-e4e04231a0f5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:46.746447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:46.800162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733da63-6d41-4a9e-b58e-e4e04231a0f5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:46.832619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:46.833210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:46.833483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:46.833751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:46.834431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:46.834733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:46.836082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:46.843780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 595/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:46.849590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:46.948862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25588039-cd1e-4186-a9aa-7aff9e5d53b8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:46.981598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:46.982221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:46.982531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:46.982807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] PATH_INFO: `/v3/users/49ef07d690f14d8783116d0f7f829aeb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:46.996618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=49ef07d690f14d8783116d0f7f829aeb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:46.998067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:46.999699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 587/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:46 2022] GET /identity/v3/users/49ef07d690f14d8783116d0f7f829aeb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:47.005527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:47.101153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7b0b-96e4-4827-a924-1d20179991c3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:47.103446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:47.135427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:47.136060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:47.136337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:47.136608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:47.201622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:47.203113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:47.299224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 596/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:47.305211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:47.339993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:47.401081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d67a9-2542-4ec8-bfe3-1fae5ed4d9f1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:47.433372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671453b5-45c2-4f9a-a503-792dd9ffb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:47.434526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671453b5-45c2-4f9a-a503-792dd9ffb871 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:47.435065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671453b5-45c2-4f9a-a503-792dd9ffb871 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:47.435339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671453b5-45c2-4f9a-a503-792dd9ffb871 None admin] PATH_INFO: `/v3/projects/3fcbea164ecd45feb1f095f5a370de6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:47.436469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671453b5-45c2-4f9a-a503-792dd9ffb871 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcbea164ecd45feb1f095f5a370de6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:47.437923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671453b5-45c2-4f9a-a503-792dd9ffb871 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:47.439589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 588/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:47 2022] GET /identity/v3/projects/3fcbea164ecd45feb1f095f5a370de6d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:47.445750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:47.448819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:47.541332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485525f-99d1-4383-b437-32e7cf39640f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:47.574737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7568f4-2072-4c1f-bf7f-9a1c5cf26178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:47.575327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7568f4-2072-4c1f-bf7f-9a1c5cf26178 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:47.575602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7568f4-2072-4c1f-bf7f-9a1c5cf26178 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:47.575874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7568f4-2072-4c1f-bf7f-9a1c5cf26178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:47.576582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7568f4-2072-4c1f-bf7f-9a1c5cf26178 None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=3fcbea164ecd45feb1f095f5a370de6d, user.id=49ef07d690f14d8783116d0f7f829aeb) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:47.576887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7568f4-2072-4c1f-bf7f-9a1c5cf26178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:47.578293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7568f4-2072-4c1f-bf7f-9a1c5cf26178 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:47.583442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 597/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:47 2022] GET /identity/v3/role_assignments?user.id=49ef07d690f14d8783116d0f7f829aeb&scope.project.id=3fcbea164ecd45feb1f095f5a370de6d&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:49.686546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf522-2d5b-410d-a4e9-82bd742b0ea5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:49.687071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf522-2d5b-410d-a4e9-82bd742b0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:49.687071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf522-2d5b-410d-a4e9-82bd742b0ea5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:49.688412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 589/1186] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:49.693752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df068da-dc20-48fd-aa17-cffd0fde42d2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:49.694134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df068da-dc20-48fd-aa17-cffd0fde42d2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:49.694303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df068da-dc20-48fd-aa17-cffd0fde42d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:49.712595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9df068da-dc20-48fd-aa17-cffd0fde42d2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:49.713785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9df068da-dc20-48fd-aa17-cffd0fde42d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:49.772828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:49.778442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 598/1187] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:50.057557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf522-2d5b-410d-a4e9-82bd742b0ea5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:50.156009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf522-2d5b-410d-a4e9-82bd742b0ea5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:50.158255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:50.188905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:50.189515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:50.189792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:50.190063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:50.199651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:50.204422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:50.205510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:24:50.206576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 590/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:50.211371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df068da-dc20-48fd-aa17-cffd0fde42d2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:50.308407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df068da-dc20-48fd-aa17-cffd0fde42d2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:50.341228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:50.341830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:50.342110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:50.342408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:50.343069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:50.343374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:50.344745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:50.352538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 599/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:50.359040 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:50.455997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b623-2ff7-4696-93a4-053b4300b3fb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:50.489093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:50.489703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:50.489983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:50.490252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] PATH_INFO: `/v3/users/49ef07d690f14d8783116d0f7f829aeb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:50.491389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] RBAC: Authorizing `identity:get_user(user_id=49ef07d690f14d8783116d0f7f829aeb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:50.492816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:50.494396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 591/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:50 2022] GET /identity/v3/users/49ef07d690f14d8783116d0f7f829aeb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:24:50.500475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:50.557017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:50.598129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017170e-e110-4e5a-b471-fbab17cd55e1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:50.631351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c48257-e833-4a5c-9147-37acce32d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:50.631971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48257-e833-4a5c-9147-37acce32d91f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:50.632251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48257-e833-4a5c-9147-37acce32d91f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:50.632528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48257-e833-4a5c-9147-37acce32d91f None admin] PATH_INFO: `/v3/projects/3fcbea164ecd45feb1f095f5a370de6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:50.633635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c48257-e833-4a5c-9147-37acce32d91f None admin] RBAC: Authorizing `identity:get_project(project_id=3fcbea164ecd45feb1f095f5a370de6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:50.635105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c48257-e833-4a5c-9147-37acce32d91f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:50.636746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 600/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:50 2022] GET /identity/v3/projects/3fcbea164ecd45feb1f095f5a370de6d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:50.642779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:50.673252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:50.741123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae83f68-e283-4a43-9f93-1f745297d3bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:50.773541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d861-37a3-468b-ac04-95d26e373ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:50.774185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d861-37a3-468b-ac04-95d26e373ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:50.774500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d861-37a3-468b-ac04-95d26e373ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:50.774779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d861-37a3-468b-ac04-95d26e373ec8 None admin] PATH_INFO: `/v3/projects/3fcbea164ecd45feb1f095f5a370de6d/users/49ef07d690f14d8783116d0f7f829aeb/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:50.776670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d861-37a3-468b-ac04-95d26e373ec8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fcbea164ecd45feb1f095f5a370de6d, user_id=49ef07d690f14d8783116d0f7f829aeb, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:50.778719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d861-37a3-468b-ac04-95d26e373ec8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:50.790872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 592/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:24:50 2022] PUT /identity/v3/projects/3fcbea164ecd45feb1f095f5a370de6d/users/49ef07d690f14d8783116d0f7f829aeb/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:24:52.881213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bced73-0f23-4801-9e32-190817275303 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:52.881736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bced73-0f23-4801-9e32-190817275303 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:52.881853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bced73-0f23-4801-9e32-190817275303 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:52.883143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 601/1193] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:24:52.888866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bb60-0ff5-4c6d-ad33-bd1d3213dccf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:52.889254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bb60-0ff5-4c6d-ad33-bd1d3213dccf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:52.889413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bb60-0ff5-4c6d-ad33-bd1d3213dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:52.909084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-33d9bb60-0ff5-4c6d-ad33-bd1d3213dccf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:24:52.910300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-33d9bb60-0ff5-4c6d-ad33-bd1d3213dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:24:52.975252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 593/1194] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:24:53.239872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bced73-0f23-4801-9e32-190817275303 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:53.342293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bced73-0f23-4801-9e32-190817275303 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:53.367275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:53.375020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:53.375645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:53.375926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:53.376200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:53.386376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:24:53.391149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:24:53.392291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:24:53.393287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 602/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:24:53.398373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9bb60-0ff5-4c6d-ad33-bd1d3213dccf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:53.422110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:53.494071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9bb60-0ff5-4c6d-ad33-bd1d3213dccf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:53.526043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:53.526660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:53.527481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:53.527749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:53.528403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:53.528702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:53.530061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:53.537650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 594/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:53.543617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:53.638538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b6005-18ae-4657-ba35-870ea5527a3d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:53.671475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:53.672107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:53.672386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:53.672658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] PATH_INFO: `/v3/users/49ef07d690f14d8783116d0f7f829aeb` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:53.673794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] RBAC: Authorizing `identity:get_user(user_id=49ef07d690f14d8783116d0f7f829aeb)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:53.675255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:53.676826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 603/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Sep 25 04:24:53 2022] GET /identity/v3/users/49ef07d690f14d8783116d0f7f829aeb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:53.682725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:53.765949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:53.781694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38011-a2ac-42e8-9c6a-865ad269fbb7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:53.814745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:53.815354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:53.815632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:53.815903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:53.883747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:53.885198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:53.970187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:53.988328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 595/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:24:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:24:53.994588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:54.060091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:24:54.104784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e000e-edfb-47fe-b090-cac3c405f73f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:54.139781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eaf0d-e183-4739-b76c-13c4be21a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:54.140438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaf0d-e183-4739-b76c-13c4be21a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:54.140719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaf0d-e183-4739-b76c-13c4be21a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:54.140997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaf0d-e183-4739-b76c-13c4be21a6b2 None admin] PATH_INFO: `/v3/projects/3fcbea164ecd45feb1f095f5a370de6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:54.142112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eaf0d-e183-4739-b76c-13c4be21a6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcbea164ecd45feb1f095f5a370de6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:54.143588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eaf0d-e183-4739-b76c-13c4be21a6b2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:54.145218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 604/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Sep 25 04:24:53 2022] GET /identity/v3/projects/3fcbea164ecd45feb1f095f5a370de6d => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:24:54.151377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:24:54.248508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac9a7-9214-41c0-a139-f38b9966029d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:24:54.281982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d6077-ca24-4a82-b836-27b7796a3d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:24:54.282620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6077-ca24-4a82-b836-27b7796a3d6a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:24:54.282898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6077-ca24-4a82-b836-27b7796a3d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:24:54.283167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6077-ca24-4a82-b836-27b7796a3d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:24:54.283884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6077-ca24-4a82-b836-27b7796a3d6a None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=3fcbea164ecd45feb1f095f5a370de6d, user.id=49ef07d690f14d8783116d0f7f829aeb) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:24:54.284192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6077-ca24-4a82-b836-27b7796a3d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:24:54.285624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6077-ca24-4a82-b836-27b7796a3d6a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:24:54.291385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 596/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:24:54 2022] GET /identity/v3/role_assignments?user.id=49ef07d690f14d8783116d0f7f829aeb&scope.project.id=3fcbea164ecd45feb1f095f5a370de6d&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:04.134767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=38 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:04.288758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=76 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:49.441440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc3d6-ac6c-4a0f-a9a1-fdd80f732467 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:49.442028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc3d6-ac6c-4a0f-a9a1-fdd80f732467 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:49.442028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc3d6-ac6c-4a0f-a9a1-fdd80f732467 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:49.443572 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 605/1201] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:25:49.449261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb5cf4-563c-41b5-897d-f01a25e6d99c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:49.449749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb5cf4-563c-41b5-897d-f01a25e6d99c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:49.449834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb5cf4-563c-41b5-897d-f01a25e6d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:49.474527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5acb5cf4-563c-41b5-897d-f01a25e6d99c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:25:49.476123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5acb5cf4-563c-41b5-897d-f01a25e6d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:25:49.567210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 597/1202] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:25:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:25:49.836545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dc3d6-ac6c-4a0f-a9a1-fdd80f732467 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:49.957150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dc3d6-ac6c-4a0f-a9a1-fdd80f732467 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:49.993386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:49.994024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:49.994315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:49.995195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:50.005805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:50.007550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:25:50.027049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:50.028170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:25:50.029137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:25:50.029137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:50.029137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:25:50.029137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 606/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:50.038383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb5cf4-563c-41b5-897d-f01a25e6d99c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:50.163915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb5cf4-563c-41b5-897d-f01a25e6d99c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:50.197831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:50.210953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836e1fe-e698-4df2-989a-7e590f0ae194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:50.211748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e1fe-e698-4df2-989a-7e590f0ae194 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:50.212711 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e1fe-e698-4df2-989a-7e590f0ae194 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:50.213071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e1fe-e698-4df2-989a-7e590f0ae194 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:50.213893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836e1fe-e698-4df2-989a-7e590f0ae194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:50.214554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836e1fe-e698-4df2-989a-7e590f0ae194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:50.216130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836e1fe-e698-4df2-989a-7e590f0ae194 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:50.236781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 598/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:50.238582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:50.316563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:50.384470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9facb0a-ba6c-4f7d-85b1-0e70a8981eb4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:50.428697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb9fb4-b0e3-4b99-853a-02f053026920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:50.429313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9fb4-b0e3-4b99-853a-02f053026920 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:50.429594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9fb4-b0e3-4b99-853a-02f053026920 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:50.429892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9fb4-b0e3-4b99-853a-02f053026920 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:50.430587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb9fb4-b0e3-4b99-853a-02f053026920 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:50.432199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb9fb4-b0e3-4b99-853a-02f053026920 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:50.458049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 607/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Sep 25 04:25:50 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:25:52.934324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51574-a81f-46d6-a35c-2e835dc05231 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:52.935193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51574-a81f-46d6-a35c-2e835dc05231 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:52.935193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51574-a81f-46d6-a35c-2e835dc05231 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:52.936521 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 599/1206] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:25:52.943706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e83be-ca09-43bf-a83b-82400c73102f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:52.944246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e83be-ca09-43bf-a83b-82400c73102f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:52.944246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e83be-ca09-43bf-a83b-82400c73102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:52.967748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6f0e83be-ca09-43bf-a83b-82400c73102f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:25:52.969159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6f0e83be-ca09-43bf-a83b-82400c73102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:25:53.044890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 608/1207] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:25:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:25:53.342758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51574-a81f-46d6-a35c-2e835dc05231 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:53.473508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51574-a81f-46d6-a35c-2e835dc05231 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:53.511179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:53.511852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:53.512157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:53.512395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:53.523708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:25:53.529182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:53.530790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:25:53.531861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 600/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:53.536302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e83be-ca09-43bf-a83b-82400c73102f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:53.581621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:53.649591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e83be-ca09-43bf-a83b-82400c73102f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:53.688198 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:53.689408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:53.689408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:53.689408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:53.690003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:53.690411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:53.691725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:53.702507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 609/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:53.708309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:53.772811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:53.834604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162745ed-1575-480d-aa84-21fd3b32eb35 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:53.876554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:53.877191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:53.877470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:53.877742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:53.891295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:53.892753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:25:53.907962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:53.909141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:25:53.910319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:25:53.910319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:53.910319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:25:53.913831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 601/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:53.915286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:54.030579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:54.033461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3cfa6-29c0-43e1-8286-219b2cf4a261 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:54.068734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:54.069348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:54.069628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:54.069906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:54.070579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:54.070886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:54.072327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:54.084559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 610/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:25:54.091280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:54.210216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf529e6-811d-436f-b6af-ed7e0063ff4c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:54.212475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:54.267689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:54.268332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:54.268622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:54.268892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:54.277842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:54.279765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:25:54.294512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:54.295801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:25:54.296757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 602/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:25:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:54.300253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:54.421900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abcc99-1b8d-472c-8f91-1eff0b9d1c66 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:54.462601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:54.463794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:54.464315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:54.464794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:54.465773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:54.466378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:54.468075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:54.486784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 611/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Sep 25 04:25:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:54.493066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:54.611817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ef24f-3cbc-4318-95ed-15f5850bd84a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:54.656162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:54.656755 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:54.657108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:54.657402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:54.692914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:54.753877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:54.755571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:54.876768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 603/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:25:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:25:54.882717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:54.903931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:55.000462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b900f9-0bb2-423d-9be9-caf7b0b9280a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:55.041858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:55.042593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:55.042871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:55.043262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:55.056018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:55.056645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:25:55.075783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:55.076802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:25:55.077737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:25:55.077737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:55.077737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:25:55.077737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 612/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:55.085657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:55.157848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:55.204497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93519e8-6ab4-4ac0-b65e-d7ef3ab6d54e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:55.243786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:55.244464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:55.244718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:55.245009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:55.245753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:55.246054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:55.247563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:55.262112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 604/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:55.266794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:55.351167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:55.390292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e991606-0a86-4ee5-9bb3-e51eb3eb07e2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:55.441176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:55.442381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:55.442381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:55.442381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:55.450986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:55.452441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:25:55.469618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:55.470810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:25:55.473052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 613/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:55.480180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:55.592373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093ded-0412-442b-95b9-c8b4bcba5f5d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:55.616859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:55.633424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb95475-abda-423b-876c-d5ff72fba829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:55.634367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb95475-abda-423b-876c-d5ff72fba829 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:55.634495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb95475-abda-423b-876c-d5ff72fba829 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:55.634774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb95475-abda-423b-876c-d5ff72fba829 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:55.635851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb95475-abda-423b-876c-d5ff72fba829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:55.636194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb95475-abda-423b-876c-d5ff72fba829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:55.637691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb95475-abda-423b-876c-d5ff72fba829 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:55.655926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 605/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:25:55.662551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:55.789164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c7a29-9a8c-43c3-b852-6336b76e84e3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:55.822145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:55.829919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d58a7e-4e6a-47d4-9fa1-96a9898a3bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:55.830564 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d58a7e-4e6a-47d4-9fa1-96a9898a3bef None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:55.830845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d58a7e-4e6a-47d4-9fa1-96a9898a3bef None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:55.831116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d58a7e-4e6a-47d4-9fa1-96a9898a3bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:55.831839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d58a7e-4e6a-47d4-9fa1-96a9898a3bef None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=e7dd8be65a664bba8a5b326943158418) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:55.832146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d58a7e-4e6a-47d4-9fa1-96a9898a3bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:55.833571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d58a7e-4e6a-47d4-9fa1-96a9898a3bef None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:55.839592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 614/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:25:55 2022] GET /identity/v3/role_assignments?user.id=e7dd8be65a664bba8a5b326943158418&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:58.206195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4898eb5-20a2-402c-aaea-90186e0d1436 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:58.206769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4898eb5-20a2-402c-aaea-90186e0d1436 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:58.206769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4898eb5-20a2-402c-aaea-90186e0d1436 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:58.208289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 606/1220] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:25:58.214260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87959c2b-fa8a-43d1-ac2c-87ceb8e19921 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:58.214684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87959c2b-fa8a-43d1-ac2c-87ceb8e19921 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:58.214935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87959c2b-fa8a-43d1-ac2c-87ceb8e19921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:58.236977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-87959c2b-fa8a-43d1-ac2c-87ceb8e19921 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:25:58.238173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-87959c2b-fa8a-43d1-ac2c-87ceb8e19921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:25:58.314612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 615/1221] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:25:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:25:58.598335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4898eb5-20a2-402c-aaea-90186e0d1436 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:58.704471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4898eb5-20a2-402c-aaea-90186e0d1436 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:58.746965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:58.747598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:58.747876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:58.748153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:58.759070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:25:58.763854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:58.765614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:25:58.768199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 607/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:58.773122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87959c2b-fa8a-43d1-ac2c-87ceb8e19921 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:58.875968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87959c2b-fa8a-43d1-ac2c-87ceb8e19921 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:58.901983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:58.915094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:58.915792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:58.916183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:58.916472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:58.917240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:58.917588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:58.919241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:58.931788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 616/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:25:58.937971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:58.987680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:59.052758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858d97b-6589-4864-a4c8-94a84edf3da9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:59.089626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:59.090259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:59.090574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:59.090848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:59.101602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:59.103143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:25:59.119653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:59.120825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:25:59.121971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:25:59.121971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:59.121971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:25:59.121971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 608/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:25:59.126802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:59.234413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb3f23-fe06-4c63-8b66-11a2b1a52bec None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:59.277491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:59.278279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:59.278664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:59.278943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:59.279592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:59.279909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:59.281311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:59.294646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 617/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:59.300275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:59.397026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:59.406753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8edb-38ee-45e4-94b6-fddd7727aad6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:59.446265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:59.446929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:59.447208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:59.447485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:59.455158 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:59.456609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:25:59.467903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:59.469082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:25:59.470134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:25:59.470724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 609/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:25:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:59.476188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:59.526459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:25:59.580607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910438-9158-469d-a53e-57803c492f36 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:59.615342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:59.615942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:59.616217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:59.616486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:59.617207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:25:59.617508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:59.619056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:59.637216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 618/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Sep 25 04:25:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:25:59.643898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:59.763840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3f2e-8047-4e64-ae7c-4ee8b9cc65d0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:59.802892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:25:59.803576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:25:59.803916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:25:59.804197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:25:59.816245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:25:59.817698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:25:59.832307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:25:59.833476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:25:59.834618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:25:59.834618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:25:59.834618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:25:59.834618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 610/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:25:59.841257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:25:59.959961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c7a9-7b9f-4565-9578-99ff3f9e6e71 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:25:59.962737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:00.000471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:00.001217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:00.001507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:00.001783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:00.002569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:00.002881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:00.004511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:00.017555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 619/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:00.023355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:00.033302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:00.138850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5a203-e450-478b-9af2-bb0859790e96 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:00.175465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:00.176099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:00.176380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:00.176649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:00.184171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:00.185975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:26:00.198881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:00.199776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:00.200680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 611/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:00.206540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:00.312654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bde0-4c12-433f-b3f5-978864465610 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:00.348323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85518a-464c-4ee2-90db-50851f9e7974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:00.349033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85518a-464c-4ee2-90db-50851f9e7974 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:00.349342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85518a-464c-4ee2-90db-50851f9e7974 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:00.349669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85518a-464c-4ee2-90db-50851f9e7974 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:00.350387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85518a-464c-4ee2-90db-50851f9e7974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:00.350696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85518a-464c-4ee2-90db-50851f9e7974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:00.352653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85518a-464c-4ee2-90db-50851f9e7974 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:00.365450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 620/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:00.372009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:00.442265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:00.484251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0534-8e53-4c08-a66e-b837cbe7f866 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:00.523523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b87fca-fddf-49b9-bc12-bc39185154e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:00.524770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b87fca-fddf-49b9-bc12-bc39185154e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:00.525046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b87fca-fddf-49b9-bc12-bc39185154e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:00.525313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b87fca-fddf-49b9-bc12-bc39185154e6 None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/e7dd8be65a664bba8a5b326943158418/roles/ffccef46ca484651b96df0b7a6254ff4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:00.540878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b87fca-fddf-49b9-bc12-bc39185154e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=e7dd8be65a664bba8a5b326943158418, role_id=ffccef46ca484651b96df0b7a6254ff4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:00.542588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b87fca-fddf-49b9-bc12-bc39185154e6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:00.557018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 612/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:26:00 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/e7dd8be65a664bba8a5b326943158418/roles/ffccef46ca484651b96df0b7a6254ff4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:26:02.697064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16b49-1938-43f8-bf47-ccea0a2dc04f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:02.697687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16b49-1938-43f8-bf47-ccea0a2dc04f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:02.697687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16b49-1938-43f8-bf47-ccea0a2dc04f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:02.699118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 621/1233] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:02.705021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac1db-ea64-4776-9ac5-c2b4c456c0d5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:02.705480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac1db-ea64-4776-9ac5-c2b4c456c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:02.705660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac1db-ea64-4776-9ac5-c2b4c456c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:02.724081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9eaac1db-ea64-4776-9ac5-c2b4c456c0d5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:02.725291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9eaac1db-ea64-4776-9ac5-c2b4c456c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:02.805906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 613/1234] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:26:03.083271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b16b49-1938-43f8-bf47-ccea0a2dc04f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:03.108249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:03.190097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b16b49-1938-43f8-bf47-ccea0a2dc04f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:03.233975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:03.234744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:03.235028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:03.235307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:03.248074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:26:03.252957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:03.254382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:03.260374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 622/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Sep 25 04:26:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:03.261084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaac1db-ea64-4776-9ac5-c2b4c456c0d5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:03.317898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:03.381973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaac1db-ea64-4776-9ac5-c2b4c456c0d5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:03.419700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:03.420361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:03.420629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:03.420973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:03.421689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:03.421995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:03.423452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:03.432442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 614/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Sep 25 04:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:03.438995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:03.532395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:03.553646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af051622-efe4-446c-9d5f-861bacb2c4c4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:03.592799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:03.593479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:03.593762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:03.594036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:03.604666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:03.606115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:03.621145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:03.627509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:03.628649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:03.628649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:03.628649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:03.628649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 623/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:03.630288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:03.743560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc721-39a3-4964-8b39-51d6062af9f4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:03.753631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:03.784311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:03.784926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:03.785205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:03.785481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:03.786126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:03.786457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:03.787830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:03.806456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 615/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:03.813685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:03.930153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723b64a-6974-485b-bdc6-2adcf270a392 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:03.976133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:03.976776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:03.977078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:03.977355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:03.980386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:03.987591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:03.989499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:26:04.004404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:04.005550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:04.006800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 624/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:04.012988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:04.115805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102b62-9802-4dab-8331-83ff432e8a8c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:04.156647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:04.157279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:04.157536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:04.157866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:04.158567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:04.158874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:04.160304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:04.179343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 616/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Sep 25 04:26:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:04.185557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:04.291955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356f77-a7b3-4a42-8f55-d9c1ae06f05e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:04.327019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:04.327625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:04.327900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:04.328173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:04.396419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:04.404996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:04.406498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:04.511087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 625/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:26:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 04:26:04.517028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:04.548602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:04.642707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea16fb-fdc9-4256-9886-188c8ed46895 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:04.692800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:04.693495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:04.693810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:04.694080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:04.704370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:04.705830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:04.727723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:04.729070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:04.730006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:04.730006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:04.730006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:04.730006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 617/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 04:26:04.735720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:04.865750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:04.872678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812d956-0e77-4cf1-9577-6ef78959d87f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:04.908107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:04.908766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:04.909049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:04.909413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:04.910153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:04.910546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:04.911933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:04.926666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 626/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:26:04.934242 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:05.027016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:05.050276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de2c9-c325-47b1-8997-aec760e4c15c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:05.086332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:05.087000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:05.087347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:05.087656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:05.096703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:05.099447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:26:05.111999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:05.113132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:05.114248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 618/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:05.119917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:05.228015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22bd2-aa89-4206-9b1a-e49998104f33 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:05.270186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28200bd8-1db9-47e0-a7f8-f4fd97110e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:05.270840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200bd8-1db9-47e0-a7f8-f4fd97110e6f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:05.271170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200bd8-1db9-47e0-a7f8-f4fd97110e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:05.271505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200bd8-1db9-47e0-a7f8-f4fd97110e6f None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:05.272253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28200bd8-1db9-47e0-a7f8-f4fd97110e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:05.272606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28200bd8-1db9-47e0-a7f8-f4fd97110e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:05.274210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28200bd8-1db9-47e0-a7f8-f4fd97110e6f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:05.290383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 627/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:26:05.294597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:05.402899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719ed4-9a25-45fe-82ff-fe4e87fa3035 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:05.443109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55a9e0-6e17-4e0f-a0fe-5cee184d927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:05.443721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a9e0-6e17-4e0f-a0fe-5cee184d927d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:05.444002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a9e0-6e17-4e0f-a0fe-5cee184d927d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:05.444273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a9e0-6e17-4e0f-a0fe-5cee184d927d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:05.445060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55a9e0-6e17-4e0f-a0fe-5cee184d927d None admin] RBAC: Adding query filter params (role.id=ffccef46ca484651b96df0b7a6254ff4, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=e7dd8be65a664bba8a5b326943158418) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:05.445348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55a9e0-6e17-4e0f-a0fe-5cee184d927d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:05.447324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55a9e0-6e17-4e0f-a0fe-5cee184d927d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:05.453846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 619/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:26:05 2022] GET /identity/v3/role_assignments?user.id=e7dd8be65a664bba8a5b326943158418&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=ffccef46ca484651b96df0b7a6254ff4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:08.171610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fdf7-3014-4904-850a-ce86a01aa501 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:08.172202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fdf7-3014-4904-850a-ce86a01aa501 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:08.172202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fdf7-3014-4904-850a-ce86a01aa501 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:08.173493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 628/1247] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:08.179806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5e0f-a2a3-4ac8-80d4-58b320c22d17 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:08.180587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5e0f-a2a3-4ac8-80d4-58b320c22d17 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:08.180587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5e0f-a2a3-4ac8-80d4-58b320c22d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:08.188519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:08.201398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1e0d5e0f-a2a3-4ac8-80d4-58b320c22d17 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:08.202657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1e0d5e0f-a2a3-4ac8-80d4-58b320c22d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:08.276251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 620/1248] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:26:08.541082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fdf7-3014-4904-850a-ce86a01aa501 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:08.559906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:08.649295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fdf7-3014-4904-850a-ce86a01aa501 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:08.685291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:08.685929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:08.686204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:08.686508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:08.697271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:26:08.702213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:08.703283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:08.704191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 629/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:08.709663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5e0f-a2a3-4ac8-80d4-58b320c22d17 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:08.814913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5e0f-a2a3-4ac8-80d4-58b320c22d17 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:08.848371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:08.854170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:08.854811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:08.855089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:08.855357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:08.856037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:08.856334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:08.857700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:08.866169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 621/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:08.872659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:08.959436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:08.992098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd801-7a39-4e4b-aadb-db213f3c6f18 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:09.026055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:09.026712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:09.026991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:09.027267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:09.037348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:09.038874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:09.054488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:09.055724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:09.056871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:09.056871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:09.056871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:09.056871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 630/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:09.063220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:09.163184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102383-dfbe-4010-a87c-2ee1747a6ec9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:09.196279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:09.196885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:09.197164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:09.197434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:09.198063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:09.198382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:09.199739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:09.211030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 622/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:09.217245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:09.313798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39438-ed5b-4a9f-b0a3-9168356aeb41 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:09.340778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:09.348686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:09.349306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:09.349585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:09.349859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:09.357884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:09.359347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:26:09.370222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:09.371370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:09.372552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 631/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:09.377071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:09.430496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:09.474191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b1311-36a8-4230-b4ea-df59b72ccbdf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:09.506935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:09.507540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:09.507824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:09.508624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:09.509867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:09.510461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:09.512459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:09.530301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 623/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Sep 25 04:26:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:09.536062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:09.631365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad4cf-5ae5-4a47-9002-1cd3228ca3a4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:09.663267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:09.663856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:09.664167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:09.664442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:09.716985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:09.729104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:09.730563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:09.825181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 632/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:26:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:26:09.830937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:09.935181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88281e-5cdd-4db6-ab9c-3874b552aefe None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:09.952819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:09.974108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:09.974715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:09.974999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:09.975274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:09.985349 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:09.986823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:10.001510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:10.002626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:10.003748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:10.003748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:10.003748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:10.003748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 624/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:10.008291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:10.091007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:10.103166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0762980-a906-4473-91bd-ded52af59941 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:10.136193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:10.136787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:10.137066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:10.137339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:10.137972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:10.138272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:10.139649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:10.151111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 633/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:10.156555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:10.252085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18fa8-e5dc-49c1-9884-17c6772ebcbe None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:10.284959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:10.285576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:10.285854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:10.286128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:10.292590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:10.294014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:26:10.306407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:10.307466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:10.308535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 625/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:10.313452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:10.408974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e30c9-4e30-4c2d-a7e1-659f87c22413 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:10.441006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b17e04-7f0f-4f7c-abf7-30fe51ef7d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:10.441599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17e04-7f0f-4f7c-abf7-30fe51ef7d62 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:10.441878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17e04-7f0f-4f7c-abf7-30fe51ef7d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:10.442151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17e04-7f0f-4f7c-abf7-30fe51ef7d62 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:10.442872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b17e04-7f0f-4f7c-abf7-30fe51ef7d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:10.443173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b17e04-7f0f-4f7c-abf7-30fe51ef7d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:10.444592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b17e04-7f0f-4f7c-abf7-30fe51ef7d62 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:10.456554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 634/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:10.462567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:10.487250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:10.560210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8137f3c-2587-4712-953f-e10872b29b73 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:10.592580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8e32-b4d5-4d56-b01b-cdd3d2f7ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:10.593167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8e32-b4d5-4d56-b01b-cdd3d2f7ae3e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:10.593446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8e32-b4d5-4d56-b01b-cdd3d2f7ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:10.593721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8e32-b4d5-4d56-b01b-cdd3d2f7ae3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:10.594459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8e32-b4d5-4d56-b01b-cdd3d2f7ae3e None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=e7dd8be65a664bba8a5b326943158418) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:10.594768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8e32-b4d5-4d56-b01b-cdd3d2f7ae3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:10.596181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8e32-b4d5-4d56-b01b-cdd3d2f7ae3e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:10.601328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 626/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:26:10 2022] GET /identity/v3/role_assignments?user.id=e7dd8be65a664bba8a5b326943158418&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:12.677300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35598c-c2c6-4bd7-83e5-912ab0ab43ef None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:12.677828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35598c-c2c6-4bd7-83e5-912ab0ab43ef None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:12.677828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35598c-c2c6-4bd7-83e5-912ab0ab43ef None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:12.679205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 635/1261] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:12.685181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f867f1-f49d-44c7-a94d-e218de3005b1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:12.685547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f867f1-f49d-44c7-a94d-e218de3005b1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:12.685742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f867f1-f49d-44c7-a94d-e218de3005b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:12.704216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b9f867f1-f49d-44c7-a94d-e218de3005b1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:12.705420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b9f867f1-f49d-44c7-a94d-e218de3005b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:12.769539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 627/1262] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:26:13.036479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35598c-c2c6-4bd7-83e5-912ab0ab43ef None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:13.047716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:13.141725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35598c-c2c6-4bd7-83e5-912ab0ab43ef None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:13.176634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:13.177256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:13.177535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:13.177806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:13.188645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:26:13.193471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:13.194645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:13.195691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 636/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:13.200690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f867f1-f49d-44c7-a94d-e218de3005b1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:13.218341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:13.300404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f867f1-f49d-44c7-a94d-e218de3005b1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:13.332668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:13.333268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:13.333548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:13.333821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:13.334510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:13.334817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:13.336689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:13.344554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 628/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:26:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:13.350117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:13.415111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:13.454637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435b7ca-fd23-457b-acee-26e99bb1c25f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:13.489735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:13.490422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:13.490708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:13.490992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:13.501753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:13.503364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:13.518176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:13.519323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:13.520409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:13.520409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:13.520409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:13.520409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 637/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:13.525755 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:13.604386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:13.623674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bbb59-6fa1-4f1c-b8be-8f27a64f79bf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:13.656995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:13.657617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:13.657901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:13.658261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:13.658935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:13.659239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:13.660603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:13.673216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 629/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:13.678874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:13.779831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349fd76-65ee-4de3-9776-cdc771b8efb0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:13.799260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:13.813689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:13.814315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:13.814623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:13.814896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:13.822856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:13.824287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:26:13.835048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:13.836500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:13.837523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 638/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:13.842764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:13.942062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a74cb1-a373-4445-ac34-2fe718477f38 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:13.975750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:13.976352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:13.976633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:13.976907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:13.977633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:13.977937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:13.979407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:13.987697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:13.996636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 630/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Sep 25 04:26:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:14.002430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:14.105670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d9119-d666-4600-8027-518e0b4d5da3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:14.138789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:14.139409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:14.139688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:14.139962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:14.150725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:14.152163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:14.165902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:14.167031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:14.168375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:14.168375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:14.168375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:14.168375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 639/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:14.172697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:14.272109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5230-c5f0-469c-81f0-18e679222e33 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:14.305811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:14.306433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:14.306717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:14.306990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:14.307625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:14.307927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:14.309552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:14.321111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 631/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:14.326555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:14.356954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:14.423108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae33af-c3e0-4e1e-92e5-ce9546c8d6ac None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:14.455163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:14.455798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:14.456075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:14.456347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:14.462694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:14.464115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:26:14.475645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:14.477268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:14.478181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 640/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:14.482892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:14.539656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:14.580696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7662f-83c6-428e-8140-e10f0a29f288 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:14.612949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb960-5cfb-4495-b30f-eed7a4ba3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:14.613551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb960-5cfb-4495-b30f-eed7a4ba3e0c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:14.613831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb960-5cfb-4495-b30f-eed7a4ba3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:14.614104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb960-5cfb-4495-b30f-eed7a4ba3e0c None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:14.614821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb960-5cfb-4495-b30f-eed7a4ba3e0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:14.615130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb960-5cfb-4495-b30f-eed7a4ba3e0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:14.616553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb960-5cfb-4495-b30f-eed7a4ba3e0c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:14.628535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 632/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:14.634582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:14.723448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:14.732826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96eecc-147a-419b-b1c7-b29e992180ae None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:14.765237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447524c-b116-4041-9f33-13581866b68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:14.765882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447524c-b116-4041-9f33-13581866b68c None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:14.766158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447524c-b116-4041-9f33-13581866b68c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:14.766459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447524c-b116-4041-9f33-13581866b68c None admin] PATH_INFO: `/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/e7dd8be65a664bba8a5b326943158418/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:14.768311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447524c-b116-4041-9f33-13581866b68c None admin] RBAC: Authorizing `identity:create_grant(project_id=c3700af4ec3340d4b08be7386c0cb969, user_id=e7dd8be65a664bba8a5b326943158418, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:14.769855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447524c-b116-4041-9f33-13581866b68c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:14.782167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 641/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Sep 25 04:26:14 2022] PUT /identity/v3/projects/c3700af4ec3340d4b08be7386c0cb969/users/e7dd8be65a664bba8a5b326943158418/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:26:16.890315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2919cf-9ef8-4db8-a892-64ad972edd48 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:16.890855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2919cf-9ef8-4db8-a892-64ad972edd48 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:16.890965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2919cf-9ef8-4db8-a892-64ad972edd48 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:16.892239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 633/1274] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:16.897430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0096a7-346e-4aa7-9e17-5fe139f195b2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:16.897842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0096a7-346e-4aa7-9e17-5fe139f195b2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:16.897976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0096a7-346e-4aa7-9e17-5fe139f195b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:16.916394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ee0096a7-346e-4aa7-9e17-5fe139f195b2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:16.917604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ee0096a7-346e-4aa7-9e17-5fe139f195b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:16.993685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 642/1275] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:26:17.259323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2919cf-9ef8-4db8-a892-64ad972edd48 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:17.358173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2919cf-9ef8-4db8-a892-64ad972edd48 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:17.375157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:17.393798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:17.394452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:17.394736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:17.395019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:17.405346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 04:26:17.410177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:17.411245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:17.412275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 634/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Sep 25 04:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:17.417831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0096a7-346e-4aa7-9e17-5fe139f195b2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:17.495464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:17.514447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0096a7-346e-4aa7-9e17-5fe139f195b2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:17.548255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:17.548858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:17.549134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:17.549404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:17.550063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:17.550399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:17.551782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:17.559856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 643/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Sep 25 04:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:17.565910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:17.662166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4ead6-0976-4239-9a04-77cfbe668425 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:17.694121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:17.694759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:17.695547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:17.695821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:17.705262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:17.706713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:17.721217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:17.722405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:17.723714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:17.723714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:17.723714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:17.723714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 635/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:17.728065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:17.833171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05acc96-b6e0-4da0-abea-7e253f33a389 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:17.865179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:17.865810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:17.866091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:17.866386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:17.867579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:17.867885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:17.869252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:17.880512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 644/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:17.886928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:17.917547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:17.984358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719c130-43b4-4698-b591-0fddf6c7319e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:18.016972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:18.017584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:18.017863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:18.018137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:18.025744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:18.027198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 04:26:18.038005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:18.039208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:18.040407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 636/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:18.045392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:18.049142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:18.141545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492d03-5917-448c-ace3-c6e037d30753 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:18.175737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:18.176339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:18.176616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:18.176887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:18.177608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:18.177908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:18.179372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:18.197520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 645/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Sep 25 04:26:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:18.203427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:18.292202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:18.301930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c8805-90ac-4462-95d7-a421ef793915 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:18.334310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:18.334944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:18.335224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:18.335498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:18.401727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:18.403138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:18.487169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:18.497664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 637/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Sep 25 04:26:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 04:26:18.503495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:18.562783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:18.600333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6af97-b9a8-47f6-89e9-9877486be1f8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:18.633855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:18.634539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:18.634818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:18.635086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:18.644705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:18.646225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 04:26:18.660196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:18.661325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 04:26:18.662329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 04:26:18.662329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 04:26:18.662329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:18.662329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 646/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:18.667013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:18.762822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483109c-a266-483a-b2a9-260b01b2f81b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:18.794789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:18.795376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:18.795658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:18.795933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:18.796565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:18.796868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:18.798225 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:18.809670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 638/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Sep 25 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:18.815202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:18.909774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fabd40-4436-47e7-a09e-a8a9042a93d9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:18.925064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:18.946122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:18.946769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:18.947047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:18.947314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:18.953692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:18.955208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 04:26:18.966613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:18.967669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Sep 25 04:26:18.968948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 647/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Sep 25 04:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:18.973446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:19.022782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:19.072027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496909c3-507e-422d-8383-56a8005890f5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:19.105820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b802f3-3d4f-41a6-a6ac-c9e22863900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:19.106516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b802f3-3d4f-41a6-a6ac-c9e22863900f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:19.106824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b802f3-3d4f-41a6-a6ac-c9e22863900f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:19.107121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b802f3-3d4f-41a6-a6ac-c9e22863900f None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:19.107879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b802f3-3d4f-41a6-a6ac-c9e22863900f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:19.108217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b802f3-3d4f-41a6-a6ac-c9e22863900f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:19.109795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b802f3-3d4f-41a6-a6ac-c9e22863900f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:19.123603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 639/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Sep 25 04:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:26:19.129387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:19.225370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08aad-4ccb-48bf-b194-3cb13fcc7f62 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:19.257048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aa901-6bbe-42ee-9460-0612307d82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:19.258135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa901-6bbe-42ee-9460-0612307d82ce None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:19.258438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa901-6bbe-42ee-9460-0612307d82ce None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:19.258711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa901-6bbe-42ee-9460-0612307d82ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:19.259434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aa901-6bbe-42ee-9460-0612307d82ce None admin] RBAC: Adding query filter params (role.id=1875ffca62eb455b8c2d5afc7954f389, scope.project.id=c3700af4ec3340d4b08be7386c0cb969, user.id=e7dd8be65a664bba8a5b326943158418) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:19.259750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aa901-6bbe-42ee-9460-0612307d82ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:19.261215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aa901-6bbe-42ee-9460-0612307d82ce None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:19.267063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 648/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Sep 25 04:26:19 2022] GET /identity/v3/role_assignments?user.id=e7dd8be65a664bba8a5b326943158418&scope.project.id=c3700af4ec3340d4b08be7386c0cb969&role.id=1875ffca62eb455b8c2d5afc7954f389 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:21.392263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f56ec-b7b1-41a7-bdb0-bc9469e55937 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:21.392799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f56ec-b7b1-41a7-bdb0-bc9469e55937 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:21.392799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f56ec-b7b1-41a7-bdb0-bc9469e55937 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:21.394144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 640/1288] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:21.399985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d540-bc14-44bb-83f3-4f4055ba276f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:21.400399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d540-bc14-44bb-83f3-4f4055ba276f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:21.400544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d540-bc14-44bb-83f3-4f4055ba276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:21.418812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5702d540-bc14-44bb-83f3-4f4055ba276f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:21.421030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5702d540-bc14-44bb-83f3-4f4055ba276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:21.449949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:21.485487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 649/1289] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:26:21.751135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f56ec-b7b1-41a7-bdb0-bc9469e55937 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:21.847692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f56ec-b7b1-41a7-bdb0-bc9469e55937 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:21.858362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:21.880778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:21.881395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:21.881673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:21.881943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:21.882572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:21.883934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:21.892405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:21.893615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:21.894721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 641/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:26:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:21.899833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702d540-bc14-44bb-83f3-4f4055ba276f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:22.000309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702d540-bc14-44bb-83f3-4f4055ba276f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:22.033688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d07bb-dc9a-4102-af8f-5232e962c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:22.034237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d07bb-dc9a-4102-af8f-5232e962c1de None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:22.034543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d07bb-dc9a-4102-af8f-5232e962c1de None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:22.034815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d07bb-dc9a-4102-af8f-5232e962c1de None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:22.035437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d07bb-dc9a-4102-af8f-5232e962c1de None admin] RBAC: Adding query filter params (name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:22.035737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d07bb-dc9a-4102-af8f-5232e962c1de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:22.037085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d07bb-dc9a-4102-af8f-5232e962c1de None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:22.041708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 650/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Sep 25 04:26:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:22.047606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:22.144319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2935f-009d-422e-86d2-9a8b757932fc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:22.176940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281bafc-0284-479e-85ef-5fd454e6cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:22.177538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281bafc-0284-479e-85ef-5fd454e6cf52 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:22.177815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281bafc-0284-479e-85ef-5fd454e6cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:22.178085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281bafc-0284-479e-85ef-5fd454e6cf52 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:22.178731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281bafc-0284-479e-85ef-5fd454e6cf52 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:22.179030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281bafc-0284-479e-85ef-5fd454e6cf52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:22.180424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281bafc-0284-479e-85ef-5fd454e6cf52 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:22.184919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 642/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Sep 25 04:26:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:24.317913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3093f20-9d28-4c40-8f26-9c29ba131433 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:24.318415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3093f20-9d28-4c40-8f26-9c29ba131433 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:24.318508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3093f20-9d28-4c40-8f26-9c29ba131433 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:24.320303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 651/1293] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:24.325476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da742f5-88a5-4909-a0a3-f33e7bbe8fd1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:24.325872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da742f5-88a5-4909-a0a3-f33e7bbe8fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:24.326014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da742f5-88a5-4909-a0a3-f33e7bbe8fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:24.344358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1da742f5-88a5-4909-a0a3-f33e7bbe8fd1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:24.345544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1da742f5-88a5-4909-a0a3-f33e7bbe8fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:24.373454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:24.409473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 643/1294] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 04:26:24.673230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3093f20-9d28-4c40-8f26-9c29ba131433 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:24.703224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:24.774226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3093f20-9d28-4c40-8f26-9c29ba131433 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:24.807341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03823007-25cc-4039-bc22-dc6611ed95f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:24.807935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03823007-25cc-4039-bc22-dc6611ed95f4 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:24.808214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03823007-25cc-4039-bc22-dc6611ed95f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:24.808488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03823007-25cc-4039-bc22-dc6611ed95f4 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:24.809399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03823007-25cc-4039-bc22-dc6611ed95f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:24.810801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03823007-25cc-4039-bc22-dc6611ed95f4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:24.824788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 652/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Sep 25 04:26:24 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:26:26.926682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55c0e-e689-4670-a97d-85d541e1b72e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:26.927264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55c0e-e689-4670-a97d-85d541e1b72e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:26.927367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55c0e-e689-4670-a97d-85d541e1b72e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:26.928790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 644/1296] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:26.934830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4bd8-9fc9-4f20-ab56-e415445a51b3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:26.935288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4bd8-9fc9-4f20-ab56-e415445a51b3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:26.935288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4bd8-9fc9-4f20-ab56-e415445a51b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:26.954120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a1ef4bd8-9fc9-4f20-ab56-e415445a51b3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:26.955340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a1ef4bd8-9fc9-4f20-ab56-e415445a51b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:27.027146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 653/1297] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:26:27.289439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55c0e-e689-4670-a97d-85d541e1b72e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:27.386686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55c0e-e689-4670-a97d-85d541e1b72e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:27.418795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:27.419402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:27.419679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:27.419951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:27.420521 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:27.421878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:27.430393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:27.431571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:27.432573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 645/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:26:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:27.437418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef4bd8-9fc9-4f20-ab56-e415445a51b3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:27.455598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:27.534982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef4bd8-9fc9-4f20-ab56-e415445a51b3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:27.567539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:27.568145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:27.568426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:27.568697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:27.569317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:27.570214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:27.571611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:27.576612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 654/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Sep 25 04:26:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:27.582509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:27.612739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:27.678904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f56c-f1e4-4e48-8114-2731ccde452b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:27.711822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d133b-38b9-41c9-a8b1-8888e8966021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:27.712405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d133b-38b9-41c9-a8b1-8888e8966021 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:27.712683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d133b-38b9-41c9-a8b1-8888e8966021 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:27.712954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d133b-38b9-41c9-a8b1-8888e8966021 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:27.713638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d133b-38b9-41c9-a8b1-8888e8966021 None admin] RBAC: Adding query filter params (interface=public, service_id=9e2455f2d1004ff99fab6698ddfd27e1, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:27.713943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d133b-38b9-41c9-a8b1-8888e8966021 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:27.715327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d133b-38b9-41c9-a8b1-8888e8966021 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:27.720139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 646/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Sep 25 04:26:27 2022] GET /identity/v3/endpoints?service_id=9e2455f2d1004ff99fab6698ddfd27e1&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:27.725554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:27.805274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:27.823914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233c8db-c412-41a4-8abe-8f19aa7584dc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:27.856053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531d090-d292-4e1f-a442-22ab474ad9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:27.856647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531d090-d292-4e1f-a442-22ab474ad9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:27.856923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531d090-d292-4e1f-a442-22ab474ad9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:27.857190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531d090-d292-4e1f-a442-22ab474ad9f1 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:27.857788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531d090-d292-4e1f-a442-22ab474ad9f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:27.859171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531d090-d292-4e1f-a442-22ab474ad9f1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:27.865705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 655/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Sep 25 04:26:27 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:26:29.980563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee93a4-ec32-412c-837f-68b55c033936 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:29.981096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee93a4-ec32-412c-837f-68b55c033936 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:29.981096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee93a4-ec32-412c-837f-68b55c033936 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:29.982458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 647/1302] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:26:29.987634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477d45-dcc2-47cd-8e2f-db4477bfce7b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:29.988030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477d45-dcc2-47cd-8e2f-db4477bfce7b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:29.988178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477d45-dcc2-47cd-8e2f-db4477bfce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:30.005685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dd477d45-dcc2-47cd-8e2f-db4477bfce7b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:26:30.006899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dd477d45-dcc2-47cd-8e2f-db4477bfce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:26:30.070355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 656/1303] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:26:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 04:26:30.335001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee93a4-ec32-412c-837f-68b55c033936 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:30.426935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:30.433762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee93a4-ec32-412c-837f-68b55c033936 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:30.470886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:30.471513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:30.471790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:30.472059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:30.472632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:30.473984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 04:26:30.482615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 04:26:30.483624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 25 04:26:30.484534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 648/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Sep 25 04:26:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 04:26:30.489835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd477d45-dcc2-47cd-8e2f-db4477bfce7b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:30.563383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:30.585649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd477d45-dcc2-47cd-8e2f-db4477bfce7b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:30.618410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dfc6-2600-4273-a3b8-cdb2c0e79044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:30.619003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dfc6-2600-4273-a3b8-cdb2c0e79044 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:30.619279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dfc6-2600-4273-a3b8-cdb2c0e79044 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:30.619547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dfc6-2600-4273-a3b8-cdb2c0e79044 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:30.620161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dfc6-2600-4273-a3b8-cdb2c0e79044 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:26:30.620460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dfc6-2600-4273-a3b8-cdb2c0e79044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:30.621809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dfc6-2600-4273-a3b8-cdb2c0e79044 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:30.626695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 657/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Sep 25 04:26:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:26:30.632489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:26:30.728183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a803-9c20-4a83-a16e-dca16c1a1339 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:26:30.760324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e1fa1-317c-482d-bb08-886a01697a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:26:30.760908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e1fa1-317c-482d-bb08-886a01697a2f None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:26:30.761186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e1fa1-317c-482d-bb08-886a01697a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:26:30.761458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e1fa1-317c-482d-bb08-886a01697a2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:26:30.762102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e1fa1-317c-482d-bb08-886a01697a2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:26:30.763545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e1fa1-317c-482d-bb08-886a01697a2f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:26:30.782428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 649/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:26:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:26:40.623896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=30 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:26:40.778657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:35.015807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436394-0829-4ca3-838d-da3fb83f0a3f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:35.016360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436394-0829-4ca3-838d-da3fb83f0a3f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:35.016360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436394-0829-4ca3-838d-da3fb83f0a3f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:35.017905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 658/1307] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:35.023985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f1767-b0fa-494a-b19c-62a610e95a76 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:35.024447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f1767-b0fa-494a-b19c-62a610e95a76 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:35.024647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f1767-b0fa-494a-b19c-62a610e95a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:35.161315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e02f1767-b0fa-494a-b19c-62a610e95a76 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:35.162596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e02f1767-b0fa-494a-b19c-62a610e95a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:35.377393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 650/1308] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:35.677755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee912f-9f7a-4403-b875-de7e44884ff9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:35.678107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee912f-9f7a-4403-b875-de7e44884ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:35.678301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee912f-9f7a-4403-b875-de7e44884ff9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:35.680039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 659/1309] 10.222.0.52 () {54 vars in 964 bytes} [Sun Sep 25 04:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:35.687105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecc2b6-3452-4caf-ab8b-1c10c76aba5f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:35.687434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecc2b6-3452-4caf-ab8b-1c10c76aba5f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:35.687675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecc2b6-3452-4caf-ab8b-1c10c76aba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:35.774852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b1ecc2b6-3452-4caf-ab8b-1c10c76aba5f None None] MFA Rules not processed for user `d4f75c3e044d4b0dbad6b16ea0599bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:35.776125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b1ecc2b6-3452-4caf-ab8b-1c10c76aba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:35.799966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:35.874627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 651/1310] 10.222.0.52 () {58 vars in 1061 bytes} [Sun Sep 25 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:27:35.883707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee912f-9f7a-4403-b875-de7e44884ff9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:35.885493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-efee912f-9f7a-4403-b875-de7e44884ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:36.019465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee912f-9f7a-4403-b875-de7e44884ff9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:36.108283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d48f42-c0df-4d1c-9082-1c82a14ab279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:36.109164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48f42-c0df-4d1c-9082-1c82a14ab279 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:36.109548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48f42-c0df-4d1c-9082-1c82a14ab279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:36.109922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48f42-c0df-4d1c-9082-1c82a14ab279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:36.111686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-38d48f42-c0df-4d1c-9082-1c82a14ab279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:36.172400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:36.234643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d48f42-c0df-4d1c-9082-1c82a14ab279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:36.236142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d48f42-c0df-4d1c-9082-1c82a14ab279 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:36.263785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 660/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:27:38.741399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb726b86-d804-42f8-8312-bb4688ef495c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:38.741934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb726b86-d804-42f8-8312-bb4688ef495c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:38.741934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb726b86-d804-42f8-8312-bb4688ef495c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:38.743320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 652/1312] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:38.748503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b779d8-c095-4ce2-a858-e64e6fa3766d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:38.748930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b779d8-c095-4ce2-a858-e64e6fa3766d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:38.749036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b779d8-c095-4ce2-a858-e64e6fa3766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:38.834660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-01b779d8-c095-4ce2-a858-e64e6fa3766d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:38.835935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-01b779d8-c095-4ce2-a858-e64e6fa3766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:38.929737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 661/1313] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:27:39.214109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb726b86-d804-42f8-8312-bb4688ef495c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:39.215708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb726b86-d804-42f8-8312-bb4688ef495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:39.321843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb726b86-d804-42f8-8312-bb4688ef495c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:39.397338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:39.399954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3dee5-9532-430d-af10-4723ca2a874d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:39.400798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3dee5-9532-430d-af10-4723ca2a874d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:39.401260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3dee5-9532-430d-af10-4723ca2a874d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:39.401711 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3dee5-9532-430d-af10-4723ca2a874d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:39.403466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-27b3dee5-9532-430d-af10-4723ca2a874d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:39.511807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3dee5-9532-430d-af10-4723ca2a874d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:39.513183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3dee5-9532-430d-af10-4723ca2a874d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:39.531327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 653/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:27:42.001967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a7242-d674-4a29-83b9-9ffe2a0fc48e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:42.002560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a7242-d674-4a29-83b9-9ffe2a0fc48e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:42.002560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a7242-d674-4a29-83b9-9ffe2a0fc48e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:42.003924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 662/1315] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:42.009441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8ec2a-684c-4887-9c04-88e12a8d08f7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:42.009831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8ec2a-684c-4887-9c04-88e12a8d08f7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:42.009987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8ec2a-684c-4887-9c04-88e12a8d08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:42.083760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7ad8ec2a-684c-4887-9c04-88e12a8d08f7 None None] MFA Rules not processed for user `e2282925fe014fdfbdea6895a6eb4c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:42.084976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7ad8ec2a-684c-4887-9c04-88e12a8d08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:42.135499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:42.180293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 654/1316] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:42.478642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685183f5-22c6-4fc1-8229-15beb7ff2fb4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:42.478924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685183f5-22c6-4fc1-8229-15beb7ff2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:42.479196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685183f5-22c6-4fc1-8229-15beb7ff2fb4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:42.480548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 663/1317] 10.222.0.52 () {54 vars in 964 bytes} [Sun Sep 25 04:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:42.486096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bc720-7140-4b1a-a163-ab353c5404db None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:42.486414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bc720-7140-4b1a-a163-ab353c5404db None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:42.486693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bc720-7140-4b1a-a163-ab353c5404db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:42.562189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-891bc720-7140-4b1a-a163-ab353c5404db None None] MFA Rules not processed for user `d4f75c3e044d4b0dbad6b16ea0599bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:42.563358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-891bc720-7140-4b1a-a163-ab353c5404db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:42.637273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 655/1318] 10.222.0.52 () {58 vars in 1061 bytes} [Sun Sep 25 04:27:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:42.646632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685183f5-22c6-4fc1-8229-15beb7ff2fb4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:42.648214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-685183f5-22c6-4fc1-8229-15beb7ff2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:42.657772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:42.750697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685183f5-22c6-4fc1-8229-15beb7ff2fb4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:42.824629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba72c8-4036-45af-9975-cd1be0777133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:42.825159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba72c8-4036-45af-9975-cd1be0777133 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:42.825441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba72c8-4036-45af-9975-cd1be0777133 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:42.825713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba72c8-4036-45af-9975-cd1be0777133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:42.827386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d8ba72c8-4036-45af-9975-cd1be0777133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:42.888526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:42.935520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba72c8-4036-45af-9975-cd1be0777133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:42.936964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba72c8-4036-45af-9975-cd1be0777133 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:42.955424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 664/1319] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:27:46.006502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad311-790f-4d40-a957-5750d3f8e106 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:46.007089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad311-790f-4d40-a957-5750d3f8e106 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:46.007089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad311-790f-4d40-a957-5750d3f8e106 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:46.008422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 656/1320] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:46.013753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3425b-112a-4eea-96cc-1722df4d2796 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:46.014166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3425b-112a-4eea-96cc-1722df4d2796 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:46.014312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3425b-112a-4eea-96cc-1722df4d2796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:46.088176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bad3425b-112a-4eea-96cc-1722df4d2796 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:46.089415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bad3425b-112a-4eea-96cc-1722df4d2796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:46.183013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 665/1321] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:46.473458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad311-790f-4d40-a957-5750d3f8e106 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:46.475033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-986ad311-790f-4d40-a957-5750d3f8e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:46.524947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:46.577050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad311-790f-4d40-a957-5750d3f8e106 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:46.649523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dc666-4841-4d5b-8af7-660e510c1c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:46.650432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dc666-4841-4d5b-8af7-660e510c1c5b service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:46.650850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dc666-4841-4d5b-8af7-660e510c1c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:46.651262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dc666-4841-4d5b-8af7-660e510c1c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:46.653937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d84dc666-4841-4d5b-8af7-660e510c1c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:46.754889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:46.767839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dc666-4841-4d5b-8af7-660e510c1c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:46.769274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dc666-4841-4d5b-8af7-660e510c1c5b service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:46.787239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 657/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:27:49.603167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a187f-272f-4ab6-90fa-db3c5bcc72df None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:49.603673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a187f-272f-4ab6-90fa-db3c5bcc72df None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:49.603673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a187f-272f-4ab6-90fa-db3c5bcc72df None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:49.605219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 666/1323] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:49.610925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22cbe-ac73-4ddf-9e08-39993a61c1d8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:49.611490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22cbe-ac73-4ddf-9e08-39993a61c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:49.611599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22cbe-ac73-4ddf-9e08-39993a61c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:49.687062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-06b22cbe-ac73-4ddf-9e08-39993a61c1d8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:49.688307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-06b22cbe-ac73-4ddf-9e08-39993a61c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:49.788488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 658/1324] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:50.072025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a187f-272f-4ab6-90fa-db3c5bcc72df None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:50.073548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dd6a187f-272f-4ab6-90fa-db3c5bcc72df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:50.093040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:50.178041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a187f-272f-4ab6-90fa-db3c5bcc72df None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:50.251823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1bc0f-158d-49aa-99ea-5c7f14134b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:50.252439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bc0f-158d-49aa-99ea-5c7f14134b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:50.252723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bc0f-158d-49aa-99ea-5c7f14134b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:50.252998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bc0f-158d-49aa-99ea-5c7f14134b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:50.255249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-50e1bc0f-158d-49aa-99ea-5c7f14134b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:50.328541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:50.367165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1bc0f-158d-49aa-99ea-5c7f14134b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:50.368620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1bc0f-158d-49aa-99ea-5c7f14134b58 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:50.388733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 667/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:27:52.590320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e0aff-7e77-4678-96c9-be5849fffbee None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:52.590899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e0aff-7e77-4678-96c9-be5849fffbee None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:52.590899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e0aff-7e77-4678-96c9-be5849fffbee None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:52.592166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 659/1326] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:52.597605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4607c01-bd28-4b3c-a853-4b143b9f3ec5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:52.598038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4607c01-bd28-4b3c-a853-4b143b9f3ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:52.598158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4607c01-bd28-4b3c-a853-4b143b9f3ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:52.672648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b4607c01-bd28-4b3c-a853-4b143b9f3ec5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:52.673905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b4607c01-bd28-4b3c-a853-4b143b9f3ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:52.773554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 668/1327] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:53.071453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e0aff-7e77-4678-96c9-be5849fffbee None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:53.073553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-af9e0aff-7e77-4678-96c9-be5849fffbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:53.133359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:53.176347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e0aff-7e77-4678-96c9-be5849fffbee None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:53.250166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045957b-5bef-492e-bfd6-b0b10f2554d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:53.250800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045957b-5bef-492e-bfd6-b0b10f2554d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:53.251076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045957b-5bef-492e-bfd6-b0b10f2554d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:53.251347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045957b-5bef-492e-bfd6-b0b10f2554d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:53.252930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9045957b-5bef-492e-bfd6-b0b10f2554d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:53.365716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:53.368424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045957b-5bef-492e-bfd6-b0b10f2554d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:53.370152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045957b-5bef-492e-bfd6-b0b10f2554d0 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:53.388875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 660/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:27:55.613594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a663-99b2-49e7-9148-9662e0e476f0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:55.614087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a663-99b2-49e7-9148-9662e0e476f0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:55.614087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a663-99b2-49e7-9148-9662e0e476f0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:55.615450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 669/1329] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:55.621074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6496062-fe1d-44e7-9168-74618709d347 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:55.621484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6496062-fe1d-44e7-9168-74618709d347 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:55.621621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6496062-fe1d-44e7-9168-74618709d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:55.688360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f6496062-fe1d-44e7-9168-74618709d347 None None] MFA Rules not processed for user `e2282925fe014fdfbdea6895a6eb4c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:55.689585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f6496062-fe1d-44e7-9168-74618709d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:55.786657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 661/1330] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:56.068208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355a663-99b2-49e7-9148-9662e0e476f0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:56.069756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5355a663-99b2-49e7-9148-9662e0e476f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:56.100374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:56.173910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355a663-99b2-49e7-9148-9662e0e476f0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:56.246299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54d07b-3130-4f0d-ba5e-cc5f4a718377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:56.246936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54d07b-3130-4f0d-ba5e-cc5f4a718377 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:56.247211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54d07b-3130-4f0d-ba5e-cc5f4a718377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:56.247478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54d07b-3130-4f0d-ba5e-cc5f4a718377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:56.249064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dd54d07b-3130-4f0d-ba5e-cc5f4a718377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:56.332219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:56.366510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54d07b-3130-4f0d-ba5e-cc5f4a718377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:56.368081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54d07b-3130-4f0d-ba5e-cc5f4a718377 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:56.387424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 670/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:27:58.758733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01bf9-d71b-4d4e-95d5-84b91b547efb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:58.759262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01bf9-d71b-4d4e-95d5-84b91b547efb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:58.759356 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01bf9-d71b-4d4e-95d5-84b91b547efb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:58.760793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 662/1332] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:27:58.765917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96acf4-b2f9-4342-bb08-e1893ec1be41 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:58.766331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96acf4-b2f9-4342-bb08-e1893ec1be41 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:58.766504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96acf4-b2f9-4342-bb08-e1893ec1be41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:58.834973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6b96acf4-b2f9-4342-bb08-e1893ec1be41 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:27:58.836225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6b96acf4-b2f9-4342-bb08-e1893ec1be41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:58.932949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 671/1333] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:27:59.214112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c01bf9-d71b-4d4e-95d5-84b91b547efb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:27:59.215701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-39c01bf9-d71b-4d4e-95d5-84b91b547efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:59.285075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:59.318921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c01bf9-d71b-4d4e-95d5-84b91b547efb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:27:59.390715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11169917-c7a7-4fa0-b9d1-7229581dbe32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:27:59.391319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169917-c7a7-4fa0-b9d1-7229581dbe32 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:27:59.391597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169917-c7a7-4fa0-b9d1-7229581dbe32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:27:59.391872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169917-c7a7-4fa0-b9d1-7229581dbe32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:27:59.393477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-11169917-c7a7-4fa0-b9d1-7229581dbe32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:27:59.500095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11169917-c7a7-4fa0-b9d1-7229581dbe32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:27:59.501460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11169917-c7a7-4fa0-b9d1-7229581dbe32 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:27:59.511827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:27:59.520942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 663/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:01.763927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823aa2-bb73-4652-b4c3-5d150eb348ed None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:01.764455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823aa2-bb73-4652-b4c3-5d150eb348ed None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:01.764755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823aa2-bb73-4652-b4c3-5d150eb348ed None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:01.767074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 672/1335] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:01.772132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fb27-c196-40ba-b669-7e6903aa2e8a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:01.772606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fb27-c196-40ba-b669-7e6903aa2e8a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:01.772710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fb27-c196-40ba-b669-7e6903aa2e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:01.837987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cfe0fb27-c196-40ba-b669-7e6903aa2e8a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:01.839221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cfe0fb27-c196-40ba-b669-7e6903aa2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:01.934104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 664/1336] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:02.224102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823aa2-bb73-4652-b4c3-5d150eb348ed None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:02.225694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d3823aa2-bb73-4652-b4c3-5d150eb348ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:02.266202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:02.328987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823aa2-bb73-4652-b4c3-5d150eb348ed None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:02.399657 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16257dc-d8a1-48a6-a919-9bc34e75b3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:02.400252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16257dc-d8a1-48a6-a919-9bc34e75b3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:02.400526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16257dc-d8a1-48a6-a919-9bc34e75b3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:02.400796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16257dc-d8a1-48a6-a919-9bc34e75b3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:02.402394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f16257dc-d8a1-48a6-a919-9bc34e75b3c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:02.483967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:02.509651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16257dc-d8a1-48a6-a919-9bc34e75b3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:02.511121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16257dc-d8a1-48a6-a919-9bc34e75b3c8 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:02.529055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 673/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:05.019060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a38cc-addb-46f1-8c17-98324808f3e6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:05.019581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a38cc-addb-46f1-8c17-98324808f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:05.019581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a38cc-addb-46f1-8c17-98324808f3e6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:05.020874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 665/1338] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:05.026052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e39e87-7b4a-4b5b-9246-1bbfcfca5aac None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:05.026449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e39e87-7b4a-4b5b-9246-1bbfcfca5aac None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:05.026636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e39e87-7b4a-4b5b-9246-1bbfcfca5aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:05.090861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f0e39e87-7b4a-4b5b-9246-1bbfcfca5aac None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:05.092057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f0e39e87-7b4a-4b5b-9246-1bbfcfca5aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:05.186670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 674/1339] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:05.465085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a38cc-addb-46f1-8c17-98324808f3e6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:05.466700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d0a38cc-addb-46f1-8c17-98324808f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:05.540297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:05.567960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a38cc-addb-46f1-8c17-98324808f3e6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:05.638001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a163a-b2bf-4c6f-941c-eb96ff700be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:05.638618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a163a-b2bf-4c6f-941c-eb96ff700be4 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:05.638895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a163a-b2bf-4c6f-941c-eb96ff700be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:05.639167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a163a-b2bf-4c6f-941c-eb96ff700be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:05.640733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f55a163a-b2bf-4c6f-941c-eb96ff700be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:05.751827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a163a-b2bf-4c6f-941c-eb96ff700be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:05.753758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a163a-b2bf-4c6f-941c-eb96ff700be4 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:05.771932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 666/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:09.839844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628b4b0-f576-40de-af1a-31bf9f2cdaa6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:09.840563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628b4b0-f576-40de-af1a-31bf9f2cdaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:09.840563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628b4b0-f576-40de-af1a-31bf9f2cdaa6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:09.842101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 675/1341] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:09.848340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a5cc-0dd7-4951-b69c-babed8724bce None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:09.848821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a5cc-0dd7-4951-b69c-babed8724bce None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:09.848922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a5cc-0dd7-4951-b69c-babed8724bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:09.854938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:09.922985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a508a5cc-0dd7-4951-b69c-babed8724bce None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:09.924218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a508a5cc-0dd7-4951-b69c-babed8724bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:10.028501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 667/1342] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:10.317020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628b4b0-f576-40de-af1a-31bf9f2cdaa6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:10.318706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e628b4b0-f576-40de-af1a-31bf9f2cdaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:10.367986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:10.426686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628b4b0-f576-40de-af1a-31bf9f2cdaa6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:10.507865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11193dc4-b3ca-4362-8283-ee7fd2f08d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:10.508473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11193dc4-b3ca-4362-8283-ee7fd2f08d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:10.508753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11193dc4-b3ca-4362-8283-ee7fd2f08d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:10.509028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11193dc4-b3ca-4362-8283-ee7fd2f08d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:10.510669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-11193dc4-b3ca-4362-8283-ee7fd2f08d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:10.604637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:10.621266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11193dc4-b3ca-4362-8283-ee7fd2f08d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:10.622742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11193dc4-b3ca-4362-8283-ee7fd2f08d91 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:10.641187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 676/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:13.435646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954808-577a-48ee-a91b-85afe187dad0 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:13.436287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954808-577a-48ee-a91b-85afe187dad0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:13.436287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954808-577a-48ee-a91b-85afe187dad0 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:13.437542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 668/1344] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:13.443040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32477-ea02-4d4d-9824-5d86fae4c38b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:13.443488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32477-ea02-4d4d-9824-5d86fae4c38b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:13.443592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32477-ea02-4d4d-9824-5d86fae4c38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:13.508720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a1e32477-ea02-4d4d-9824-5d86fae4c38b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:13.509921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a1e32477-ea02-4d4d-9824-5d86fae4c38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:13.608634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 677/1345] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:13.887848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954808-577a-48ee-a91b-85afe187dad0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:13.889450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ce954808-577a-48ee-a91b-85afe187dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:13.987171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:14.004294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954808-577a-48ee-a91b-85afe187dad0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:14.078101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e702b61-17e3-4e98-851e-9ecb8fa322ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:14.078661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702b61-17e3-4e98-851e-9ecb8fa322ff service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:14.078940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702b61-17e3-4e98-851e-9ecb8fa322ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:14.079210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702b61-17e3-4e98-851e-9ecb8fa322ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:14.080845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7e702b61-17e3-4e98-851e-9ecb8fa322ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:14.191063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e702b61-17e3-4e98-851e-9ecb8fa322ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:14.192507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e702b61-17e3-4e98-851e-9ecb8fa322ff service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:14.210748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 669/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:18.320183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf4ed-320b-4e89-a4bb-cc78f59b0aeb None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:18.320783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf4ed-320b-4e89-a4bb-cc78f59b0aeb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:18.320783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf4ed-320b-4e89-a4bb-cc78f59b0aeb None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:18.322148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 678/1347] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:18.327790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34313637-224b-4f83-8d82-c1f565137a3b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:18.328581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34313637-224b-4f83-8d82-c1f565137a3b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:18.328875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34313637-224b-4f83-8d82-c1f565137a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:18.345433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:18.398475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-34313637-224b-4f83-8d82-c1f565137a3b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:18.399700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-34313637-224b-4f83-8d82-c1f565137a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:18.494045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 670/1348] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:18.776265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acf4ed-320b-4e89-a4bb-cc78f59b0aeb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:18.777895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b3acf4ed-320b-4e89-a4bb-cc78f59b0aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:18.836758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:18.885067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acf4ed-320b-4e89-a4bb-cc78f59b0aeb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:18.964973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e026e62-1cd4-494f-b782-9df7fa2e7702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:18.965582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026e62-1cd4-494f-b782-9df7fa2e7702 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:18.965865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026e62-1cd4-494f-b782-9df7fa2e7702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:18.966142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026e62-1cd4-494f-b782-9df7fa2e7702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:18.967804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8e026e62-1cd4-494f-b782-9df7fa2e7702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:19.071424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:19.075336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e026e62-1cd4-494f-b782-9df7fa2e7702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:19.076779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e026e62-1cd4-494f-b782-9df7fa2e7702 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:19.095155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 679/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:24.058121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e10a4-4cd4-447a-9075-1778124ad5e1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:24.058970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e10a4-4cd4-447a-9075-1778124ad5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:24.058970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e10a4-4cd4-447a-9075-1778124ad5e1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:24.060234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 671/1350] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:24.065947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23d7ab-05b7-40be-840e-1faf9df2cbab None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:24.066503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23d7ab-05b7-40be-840e-1faf9df2cbab None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:24.066685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23d7ab-05b7-40be-840e-1faf9df2cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:24.193305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3e23d7ab-05b7-40be-840e-1faf9df2cbab None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:24.194873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3e23d7ab-05b7-40be-840e-1faf9df2cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:24.360771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 680/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:28:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:28.452095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a9f3-ffa3-43b3-b14b-1d610fad4d9f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:28.452586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a9f3-ffa3-43b3-b14b-1d610fad4d9f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:28.452690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a9f3-ffa3-43b3-b14b-1d610fad4d9f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:28.454199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 672/1352] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:28.459033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c119-9618-4e1e-a0ad-0d9789f2e96e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:28.459851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c119-9618-4e1e-a0ad-0d9789f2e96e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:28.460460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c119-9618-4e1e-a0ad-0d9789f2e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:28.492389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=59 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:28.520770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:28.547543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fa58c119-9618-4e1e-a0ad-0d9789f2e96e None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:28.549464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fa58c119-9618-4e1e-a0ad-0d9789f2e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:28.670503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 681/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:28:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:30.002672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9bf7-c534-4b44-a90b-d687620643e3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:30.003199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9bf7-c534-4b44-a90b-d687620643e3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:30.003292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9bf7-c534-4b44-a90b-d687620643e3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:30.004627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 673/1354] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:30.009536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625847b0-c539-4bd8-ac16-0cccfb7a2558 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:30.009970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625847b0-c539-4bd8-ac16-0cccfb7a2558 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:30.010109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625847b0-c539-4bd8-ac16-0cccfb7a2558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:30.088070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-625847b0-c539-4bd8-ac16-0cccfb7a2558 None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:30.089282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-625847b0-c539-4bd8-ac16-0cccfb7a2558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:30.130067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:30.194630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 682/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:28:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:33.740408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c173-447e-44d4-acf1-cb9042132208 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:33.740971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c173-447e-44d4-acf1-cb9042132208 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:33.740971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c173-447e-44d4-acf1-cb9042132208 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:33.742278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 674/1356] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:33.748850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6cb2d-da56-45b7-a452-71aef734a354 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:33.748850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6cb2d-da56-45b7-a452-71aef734a354 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:33.749361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6cb2d-da56-45b7-a452-71aef734a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:33.848808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b9c6cb2d-da56-45b7-a452-71aef734a354 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:33.850135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b9c6cb2d-da56-45b7-a452-71aef734a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:33.967984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 683/1357] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:34.271172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b016-56cc-4158-97d7-b9f32f3600fc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:34.271329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b016-56cc-4158-97d7-b9f32f3600fc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:34.272017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b016-56cc-4158-97d7-b9f32f3600fc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:34.273368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 675/1358] 10.222.0.52 () {54 vars in 961 bytes} [Sun Sep 25 04:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:34.283014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804f4b-2b5b-4675-b2da-395e9267c2f7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:34.283525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804f4b-2b5b-4675-b2da-395e9267c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:34.283902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804f4b-2b5b-4675-b2da-395e9267c2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:34.310412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:34.374883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7f804f4b-2b5b-4675-b2da-395e9267c2f7 None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:34.376082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7f804f4b-2b5b-4675-b2da-395e9267c2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:34.499602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 684/1359] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Sep 25 04:28:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:34.507630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b016-56cc-4158-97d7-b9f32f3600fc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:34.509139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2550b016-56cc-4158-97d7-b9f32f3600fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:34.677013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b016-56cc-4158-97d7-b9f32f3600fc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:34.757886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:34.801006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c152ca8-5d32-4054-a956-b04055214285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:34.801605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152ca8-5d32-4054-a956-b04055214285 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:34.801887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152ca8-5d32-4054-a956-b04055214285 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:34.803107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152ca8-5d32-4054-a956-b04055214285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:34.804724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c152ca8-5d32-4054-a956-b04055214285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:34.905095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c152ca8-5d32-4054-a956-b04055214285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:34.906730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c152ca8-5d32-4054-a956-b04055214285 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:34.925123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 676/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:37.303540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf924a2-044a-4e07-821c-62f853fd0c79 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:37.303979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf924a2-044a-4e07-821c-62f853fd0c79 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:37.304109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf924a2-044a-4e07-821c-62f853fd0c79 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:37.305467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 685/1361] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:37.311250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a4eb-14e9-4fb6-84d3-804282a3b358 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:37.311698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a4eb-14e9-4fb6-84d3-804282a3b358 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:37.311698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a4eb-14e9-4fb6-84d3-804282a3b358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:37.384637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d270a4eb-14e9-4fb6-84d3-804282a3b358 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:37.385860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d270a4eb-14e9-4fb6-84d3-804282a3b358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:37.426652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:37.502861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 677/1362] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:28:37.792813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf924a2-044a-4e07-821c-62f853fd0c79 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:37.794406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9cf924a2-044a-4e07-821c-62f853fd0c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:37.868490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:37.963432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf924a2-044a-4e07-821c-62f853fd0c79 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:38.116486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2ea75-5643-4441-bdec-126edb330236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:38.117673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2ea75-5643-4441-bdec-126edb330236 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:38.118445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2ea75-5643-4441-bdec-126edb330236 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:38.118923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2ea75-5643-4441-bdec-126edb330236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:38.121040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bab2ea75-5643-4441-bdec-126edb330236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:38.151909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:38.233882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2ea75-5643-4441-bdec-126edb330236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:38.236043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2ea75-5643-4441-bdec-126edb330236 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:38.256423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 686/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:40.760090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bde5c9-c1fc-4cd4-a19a-a48519980ea9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:40.760654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bde5c9-c1fc-4cd4-a19a-a48519980ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:40.760654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bde5c9-c1fc-4cd4-a19a-a48519980ea9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:40.762089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 678/1364] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:40.767318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3cc1-65f5-4599-9bc2-052c48f23ae9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:40.767710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3cc1-65f5-4599-9bc2-052c48f23ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:40.767916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3cc1-65f5-4599-9bc2-052c48f23ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:40.836896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1d2c3cc1-65f5-4599-9bc2-052c48f23ae9 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:40.838177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1d2c3cc1-65f5-4599-9bc2-052c48f23ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:40.939591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:40.946486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 687/1365] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:41.226985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb654a-bee7-468f-b7f6-e495edfc8a4f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:41.227496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb654a-bee7-468f-b7f6-e495edfc8a4f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:41.227775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb654a-bee7-468f-b7f6-e495edfc8a4f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:41.229243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 679/1366] 10.222.0.52 () {54 vars in 961 bytes} [Sun Sep 25 04:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:41.234592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864b75-9f8f-4b43-81b0-a500a7fa1f1a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:41.235094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864b75-9f8f-4b43-81b0-a500a7fa1f1a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:41.236094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864b75-9f8f-4b43-81b0-a500a7fa1f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:41.319061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ca864b75-9f8f-4b43-81b0-a500a7fa1f1a None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:41.320671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ca864b75-9f8f-4b43-81b0-a500a7fa1f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:41.442240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 688/1367] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Sep 25 04:28:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:28:41.451409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb654a-bee7-468f-b7f6-e495edfc8a4f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:41.453046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8ebb654a-bee7-468f-b7f6-e495edfc8a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:41.608364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb654a-bee7-468f-b7f6-e495edfc8a4f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:41.629609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:41.727511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f50f4-6c78-477e-96a6-326bcff62640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:41.728124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f50f4-6c78-477e-96a6-326bcff62640 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:41.728404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f50f4-6c78-477e-96a6-326bcff62640 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:41.728674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f50f4-6c78-477e-96a6-326bcff62640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:41.730282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5b4f50f4-6c78-477e-96a6-326bcff62640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:41.824138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f50f4-6c78-477e-96a6-326bcff62640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:41.825770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f50f4-6c78-477e-96a6-326bcff62640 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:41.846818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 680/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:42.171308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839a2a-d47f-405a-8e5c-3f4a6d5d3128 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:42.171836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839a2a-d47f-405a-8e5c-3f4a6d5d3128 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:42.171836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839a2a-d47f-405a-8e5c-3f4a6d5d3128 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:42.173364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 689/1369] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:42.178712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e70d6a-3a40-4ec0-86bf-852ab16dded5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:42.179003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e70d6a-3a40-4ec0-86bf-852ab16dded5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:42.179279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e70d6a-3a40-4ec0-86bf-852ab16dded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:42.220412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:42.262068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-96e70d6a-3a40-4ec0-86bf-852ab16dded5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:42.265727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-96e70d6a-3a40-4ec0-86bf-852ab16dded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:42.382432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 681/1370] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:42.718438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbe1d3-79b7-4401-a0be-5570a8c61ba0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:42.718438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbe1d3-79b7-4401-a0be-5570a8c61ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:42.718438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbe1d3-79b7-4401-a0be-5570a8c61ba0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:42.721293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 690/1371] 10.222.0.52 () {54 vars in 963 bytes} [Sun Sep 25 04:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:42.725184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc2b1-62c9-4aa8-8023-90fbfaf4399b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:42.725575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc2b1-62c9-4aa8-8023-90fbfaf4399b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:42.725946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc2b1-62c9-4aa8-8023-90fbfaf4399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:42.810859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e3efc2b1-62c9-4aa8-8023-90fbfaf4399b None None] MFA Rules not processed for user `f955275faf8349fc8d42068bd774ad10`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:42.812743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e3efc2b1-62c9-4aa8-8023-90fbfaf4399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:42.866608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:42.899176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 682/1372] 10.222.0.52 () {58 vars in 1060 bytes} [Sun Sep 25 04:28:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:42.906684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbe1d3-79b7-4401-a0be-5570a8c61ba0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:42.908862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-00cbe1d3-79b7-4401-a0be-5570a8c61ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:42.963104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:43.020900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbe1d3-79b7-4401-a0be-5570a8c61ba0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:43.108845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f041e60-a8ce-4410-bd94-b60ec98ebb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:43.109499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041e60-a8ce-4410-bd94-b60ec98ebb5b service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:43.109692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041e60-a8ce-4410-bd94-b60ec98ebb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:43.109968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041e60-a8ce-4410-bd94-b60ec98ebb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:43.112169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7f041e60-a8ce-4410-bd94-b60ec98ebb5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:43.219174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:43.234544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f041e60-a8ce-4410-bd94-b60ec98ebb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:43.236083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f041e60-a8ce-4410-bd94-b60ec98ebb5b service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:43.274818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 691/1373] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:44.098073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06c2c-26b5-4b84-a236-b2544be2e1e7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:44.098799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06c2c-26b5-4b84-a236-b2544be2e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:44.098799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06c2c-26b5-4b84-a236-b2544be2e1e7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:44.100006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 683/1374] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:44.105117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3697a-9b19-48f6-ad28-212adfd3a245 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:44.105444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3697a-9b19-48f6-ad28-212adfd3a245 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:44.105724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3697a-9b19-48f6-ad28-212adfd3a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:44.174460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-92c3697a-9b19-48f6-ad28-212adfd3a245 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:44.175766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-92c3697a-9b19-48f6-ad28-212adfd3a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:44.273929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 692/1375] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:44.567995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06c2c-26b5-4b84-a236-b2544be2e1e7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:44.569569 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69d06c2c-26b5-4b84-a236-b2544be2e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:44.717416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06c2c-26b5-4b84-a236-b2544be2e1e7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:44.771990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:44.841748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbe0a3-edb7-4db9-97f3-0194074ae06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:44.842293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbe0a3-edb7-4db9-97f3-0194074ae06d service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:44.842601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbe0a3-edb7-4db9-97f3-0194074ae06d service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:44.842875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbe0a3-edb7-4db9-97f3-0194074ae06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:44.844560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a3cbe0a3-edb7-4db9-97f3-0194074ae06d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:44.942718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbe0a3-edb7-4db9-97f3-0194074ae06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:44.944333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbe0a3-edb7-4db9-97f3-0194074ae06d service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:44.963769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 684/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:47.175211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2fe4-8fa6-4b0e-acb9-152b0a872abc None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:47.175814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2fe4-8fa6-4b0e-acb9-152b0a872abc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:47.175814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2fe4-8fa6-4b0e-acb9-152b0a872abc None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:47.177091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 693/1377] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:47.182499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2580-f3f8-4420-8e16-657b8da5fbb2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:47.182973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2580-f3f8-4420-8e16-657b8da5fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:47.183383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2580-f3f8-4420-8e16-657b8da5fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:47.254528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4e3e2580-f3f8-4420-8e16-657b8da5fbb2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:47.256140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4e3e2580-f3f8-4420-8e16-657b8da5fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:47.270683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:47.361591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 685/1378] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:47.654498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2fe4-8fa6-4b0e-acb9-152b0a872abc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:47.656030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9d0d2fe4-8fa6-4b0e-acb9-152b0a872abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:47.720143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:47.809969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2fe4-8fa6-4b0e-acb9-152b0a872abc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:47.950445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6584-afea-4737-90c7-2a456c4ce1a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:47.951807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6584-afea-4737-90c7-2a456c4ce1a6 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:47.952461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6584-afea-4737-90c7-2a456c4ce1a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:47.953074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6584-afea-4737-90c7-2a456c4ce1a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:47.956243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9b7d6584-afea-4737-90c7-2a456c4ce1a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:47.978057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:48.057749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d6584-afea-4737-90c7-2a456c4ce1a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:48.059813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d6584-afea-4737-90c7-2a456c4ce1a6 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:48.081295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 694/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:50.291517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceab26-bf4e-4e53-a8e4-c1379ca7f560 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:50.292023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceab26-bf4e-4e53-a8e4-c1379ca7f560 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:50.292130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceab26-bf4e-4e53-a8e4-c1379ca7f560 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:50.293543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 686/1380] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:50.298672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e3a03-9031-471e-a4f3-210d22a9d7e8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:50.299055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e3a03-9031-471e-a4f3-210d22a9d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:50.299236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e3a03-9031-471e-a4f3-210d22a9d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:50.366516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-153e3a03-9031-471e-a4f3-210d22a9d7e8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:50.367716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-153e3a03-9031-471e-a4f3-210d22a9d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:50.460782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:50.470591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 695/1381] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:28:50.755878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceab26-bf4e-4e53-a8e4-c1379ca7f560 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:50.758418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-51ceab26-bf4e-4e53-a8e4-c1379ca7f560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:50.900185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:50.912182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceab26-bf4e-4e53-a8e4-c1379ca7f560 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:51.034470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d2b5-314e-4c05-962e-88e509590021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:51.035074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d2b5-314e-4c05-962e-88e509590021 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:51.035352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d2b5-314e-4c05-962e-88e509590021 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:51.035621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d2b5-314e-4c05-962e-88e509590021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:51.037219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5001d2b5-314e-4c05-962e-88e509590021 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:51.130526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001d2b5-314e-4c05-962e-88e509590021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:51.132502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001d2b5-314e-4c05-962e-88e509590021 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:51.143236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:51.151930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 687/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:53.774542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b188f9-af2a-44b0-9007-c33e238bf8ba None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:53.775207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b188f9-af2a-44b0-9007-c33e238bf8ba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:53.775207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b188f9-af2a-44b0-9007-c33e238bf8ba None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:53.776659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 696/1383] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:53.782237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad870a-e094-4610-918c-8956352b504d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:53.782727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad870a-e094-4610-918c-8956352b504d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:53.782895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad870a-e094-4610-918c-8956352b504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:53.850027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-94ad870a-e094-4610-918c-8956352b504d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:53.851289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-94ad870a-e094-4610-918c-8956352b504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:53.954778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 688/1384] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:54.254252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b188f9-af2a-44b0-9007-c33e238bf8ba None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:54.255942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-47b188f9-af2a-44b0-9007-c33e238bf8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:54.443793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b188f9-af2a-44b0-9007-c33e238bf8ba None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:54.517158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:54.566991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f6a5-476a-448a-96c4-9b3c3a065658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:54.567602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f6a5-476a-448a-96c4-9b3c3a065658 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:54.567920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f6a5-476a-448a-96c4-9b3c3a065658 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:54.568169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f6a5-476a-448a-96c4-9b3c3a065658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:54.569758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f1e6f6a5-476a-448a-96c4-9b3c3a065658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:54.666459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6f6a5-476a-448a-96c4-9b3c3a065658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:54.668181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6f6a5-476a-448a-96c4-9b3c3a065658 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:54.690299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 697/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:56.918515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccd9d8-a288-4843-8932-ed9a963f421e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:56.919022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccd9d8-a288-4843-8932-ed9a963f421e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:56.919022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccd9d8-a288-4843-8932-ed9a963f421e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:56.920316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 689/1386] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:56.931175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b3d9-1c55-4120-824d-16888a17fb88 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:56.931580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b3d9-1c55-4120-824d-16888a17fb88 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:56.931744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b3d9-1c55-4120-824d-16888a17fb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:56.999490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7905b3d9-1c55-4120-824d-16888a17fb88 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:57.000713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7905b3d9-1c55-4120-824d-16888a17fb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:57.041544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:57.109849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 698/1387] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:57.399880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccd9d8-a288-4843-8932-ed9a963f421e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:57.401467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-99ccd9d8-a288-4843-8932-ed9a963f421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:57.478716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:57.549602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccd9d8-a288-4843-8932-ed9a963f421e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:57.662731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab442dce-6ac0-4e3a-ae87-8c7ecbc00ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:57.663346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442dce-6ac0-4e3a-ae87-8c7ecbc00ee5 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:57.663626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442dce-6ac0-4e3a-ae87-8c7ecbc00ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:57.663895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442dce-6ac0-4e3a-ae87-8c7ecbc00ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:57.665491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ab442dce-6ac0-4e3a-ae87-8c7ecbc00ee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:57.704630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:57.758065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab442dce-6ac0-4e3a-ae87-8c7ecbc00ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:57.759695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab442dce-6ac0-4e3a-ae87-8c7ecbc00ee5 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:57.777797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 690/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:58.524221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc45e81-3aa3-455b-b1ee-efb1f35515bd None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:58.524728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc45e81-3aa3-455b-b1ee-efb1f35515bd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:58.524728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc45e81-3aa3-455b-b1ee-efb1f35515bd None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:58.526047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 699/1389] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:58.531481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647005-cbe2-4c7c-a8c2-4dbeabeab8e1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:58.531917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647005-cbe2-4c7c-a8c2-4dbeabeab8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:58.532107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647005-cbe2-4c7c-a8c2-4dbeabeab8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:58.597285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a5647005-cbe2-4c7c-a8c2-4dbeabeab8e1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:58.598537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a5647005-cbe2-4c7c-a8c2-4dbeabeab8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:58.701082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 691/1390] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:59.009193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead52cb-d5b8-40fc-b396-1a82f82b880f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:59.009554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead52cb-d5b8-40fc-b396-1a82f82b880f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:59.009891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead52cb-d5b8-40fc-b396-1a82f82b880f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:59.011322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 700/1391] 10.222.0.52 () {54 vars in 962 bytes} [Sun Sep 25 04:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:59.017282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3953-e165-470c-9f2a-8cc59cc0b48d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:59.017640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3953-e165-470c-9f2a-8cc59cc0b48d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:59.017922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3953-e165-470c-9f2a-8cc59cc0b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:59.033564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:59.096825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c08e3953-e165-470c-9f2a-8cc59cc0b48d None None] MFA Rules not processed for user `78f639af7ae54e06b8baa10e77236c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:28:59.098065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c08e3953-e165-470c-9f2a-8cc59cc0b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:59.174880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 692/1392] 10.222.0.52 () {58 vars in 1059 bytes} [Sun Sep 25 04:28:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:28:59.184206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead52cb-d5b8-40fc-b396-1a82f82b880f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:28:59.185730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bead52cb-d5b8-40fc-b396-1a82f82b880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:59.294056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead52cb-d5b8-40fc-b396-1a82f82b880f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:28:59.356249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:59.372259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5bdd-1df2-4ce8-b71a-60ec4b29eb6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:28:59.372865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5bdd-1df2-4ce8-b71a-60ec4b29eb6b service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:59.373148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5bdd-1df2-4ce8-b71a-60ec4b29eb6b service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:59.373417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5bdd-1df2-4ce8-b71a-60ec4b29eb6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:59.375040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ff9e5bdd-1df2-4ce8-b71a-60ec4b29eb6b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:28:59.494043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e5bdd-1df2-4ce8-b71a-60ec4b29eb6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:28:59.495510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e5bdd-1df2-4ce8-b71a-60ec4b29eb6b service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:28:59.513426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 701/1393] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:28:59.968877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3537-2e05-4ad1-b367-4d142b37b89a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:59.969440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3537-2e05-4ad1-b367-4d142b37b89a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:59.969440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3537-2e05-4ad1-b367-4d142b37b89a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:28:59.971423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 693/1394] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:28:59.977077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:28:59.977484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:28:59.977630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:00.046044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:00.047277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:00.091544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:00.155752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 702/1395] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:00.259883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f70f-9cf1-4531-bf20-e0b0077e223e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:00.260169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f70f-9cf1-4531-bf20-e0b0077e223e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:00.260452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f70f-9cf1-4531-bf20-e0b0077e223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:00.326530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e555f70f-9cf1-4531-bf20-e0b0077e223e None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:00.327746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e555f70f-9cf1-4531-bf20-e0b0077e223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:00.382849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:00.415094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 694/1396] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:29:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:00.447169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:00.448416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:00.458649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da93bb-0823-435f-9a20-2a95b531f5f6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:00.459011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da93bb-0823-435f-9a20-2a95b531f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:00.459355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da93bb-0823-435f-9a20-2a95b531f5f6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:00.460817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 695/1397] 10.222.0.52 () {54 vars in 943 bytes} [Sun Sep 25 04:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:00.467077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc2426-47b3-437c-85a2-2fd18958a5e4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:00.467556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc2426-47b3-437c-85a2-2fd18958a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:00.467829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc2426-47b3-437c-85a2-2fd18958a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:00.545278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4ccc2426-47b3-437c-85a2-2fd18958a5e4 None None] MFA Rules not processed for user `12819d6a0c19462d82b285502d0e27b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:00.546433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4ccc2426-47b3-437c-85a2-2fd18958a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:00.564294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377042f1-fab8-417c-99d0-f3b511a5f5a4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:00.620753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:00.654576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 696/1398] 10.222.0.52 () {58 vars in 1040 bytes} [Sun Sep 25 04:29:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:29:00.664826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc2426-47b3-437c-85a2-2fd18958a5e4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:00.675438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc2426-47b3-437c-85a2-2fd18958a5e4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:00.680310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714eb00-daa1-4293-9e7c-c4d7e3525522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:00.680932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714eb00-daa1-4293-9e7c-c4d7e3525522 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:00.681241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714eb00-daa1-4293-9e7c-c4d7e3525522 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:00.681513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714eb00-daa1-4293-9e7c-c4d7e3525522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:00.683204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d714eb00-daa1-4293-9e7c-c4d7e3525522 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:00.703892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:00.776596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714eb00-daa1-4293-9e7c-c4d7e3525522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:00.778197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714eb00-daa1-4293-9e7c-c4d7e3525522 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:00.781905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45310e7-0541-4aa9-adb8-31fb6494ecf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:00.782572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45310e7-0541-4aa9-adb8-31fb6494ecf4 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:00.782853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45310e7-0541-4aa9-adb8-31fb6494ecf4 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:00.783123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45310e7-0541-4aa9-adb8-31fb6494ecf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:00.784758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e45310e7-0541-4aa9-adb8-31fb6494ecf4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:00.797101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 703/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:00.872089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45310e7-0541-4aa9-adb8-31fb6494ecf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:00.873727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45310e7-0541-4aa9-adb8-31fb6494ecf4 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:00.883847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 697/1400] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:29:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 04:29:03.014498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ff6d6-ce26-41bf-b413-a25e54007230 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:03.015159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ff6d6-ce26-41bf-b413-a25e54007230 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:03.015159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ff6d6-ce26-41bf-b413-a25e54007230 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:03.016695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 704/1401] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:03.022272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822f45-b8e1-4cb7-b644-d4380593b096 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:03.022829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822f45-b8e1-4cb7-b644-d4380593b096 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:03.022829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822f45-b8e1-4cb7-b644-d4380593b096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:03.096874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f9822f45-b8e1-4cb7-b644-d4380593b096 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:03.098100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f9822f45-b8e1-4cb7-b644-d4380593b096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:03.105757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:03.205011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 698/1402] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:03.497423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ff6d6-ce26-41bf-b413-a25e54007230 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:03.499003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f39ff6d6-ce26-41bf-b413-a25e54007230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:03.573438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:03.668512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ff6d6-ce26-41bf-b413-a25e54007230 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:03.795308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130497b-f9d8-4afd-8313-da453796bf04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:03.795994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130497b-f9d8-4afd-8313-da453796bf04 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:03.796279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130497b-f9d8-4afd-8313-da453796bf04 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:03.796555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130497b-f9d8-4afd-8313-da453796bf04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:03.798745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0130497b-f9d8-4afd-8313-da453796bf04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:03.832026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:03.901799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130497b-f9d8-4afd-8313-da453796bf04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:03.904101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130497b-f9d8-4afd-8313-da453796bf04 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:03.923666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 705/1403] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:06.168067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9808ef-a35d-4581-8d79-50ca2db5615b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:06.168602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9808ef-a35d-4581-8d79-50ca2db5615b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:06.168602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9808ef-a35d-4581-8d79-50ca2db5615b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:06.170171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 699/1404] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:06.175738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631ab01-1fa9-4def-883a-82da9e2f9e05 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:06.176220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631ab01-1fa9-4def-883a-82da9e2f9e05 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:06.176370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631ab01-1fa9-4def-883a-82da9e2f9e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:06.249386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c631ab01-1fa9-4def-883a-82da9e2f9e05 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:06.250659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c631ab01-1fa9-4def-883a-82da9e2f9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:06.361602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 706/1405] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:06.655816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9808ef-a35d-4581-8d79-50ca2db5615b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:06.657952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9c9808ef-a35d-4581-8d79-50ca2db5615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:06.820742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:06.833433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9808ef-a35d-4581-8d79-50ca2db5615b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:06.962929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038210a-34f5-4df2-abf3-720fa766bc18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:06.963465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038210a-34f5-4df2-abf3-720fa766bc18 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:06.963742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038210a-34f5-4df2-abf3-720fa766bc18 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:06.964013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038210a-34f5-4df2-abf3-720fa766bc18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:06.965632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5038210a-34f5-4df2-abf3-720fa766bc18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:07.081100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038210a-34f5-4df2-abf3-720fa766bc18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:07.083256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038210a-34f5-4df2-abf3-720fa766bc18 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:07.095906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:07.106086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 700/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:09.322178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610781d6-1402-41e4-b2f6-687f6f471fba None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:09.322762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610781d6-1402-41e4-b2f6-687f6f471fba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:09.322762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610781d6-1402-41e4-b2f6-687f6f471fba None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:09.324144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 707/1407] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:09.329598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af702c-5033-41eb-914e-7d8c6c81ac8d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:09.330471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af702c-5033-41eb-914e-7d8c6c81ac8d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:09.330938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af702c-5033-41eb-914e-7d8c6c81ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:09.403984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b9af702c-5033-41eb-914e-7d8c6c81ac8d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:09.405224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b9af702c-5033-41eb-914e-7d8c6c81ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:09.512633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 701/1408] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:09.802506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610781d6-1402-41e4-b2f6-687f6f471fba None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:09.804098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-610781d6-1402-41e4-b2f6-687f6f471fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:09.807084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:09.982983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610781d6-1402-41e4-b2f6-687f6f471fba None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:10.070043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:10.114617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7a9e0-d0c8-4350-bdbb-eddc221cb102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:10.115226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a9e0-d0c8-4350-bdbb-eddc221cb102 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:10.115502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a9e0-d0c8-4350-bdbb-eddc221cb102 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:10.115823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a9e0-d0c8-4350-bdbb-eddc221cb102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:10.117540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-45d7a9e0-d0c8-4350-bdbb-eddc221cb102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:10.216292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a9e0-d0c8-4350-bdbb-eddc221cb102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:10.217900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a9e0-d0c8-4350-bdbb-eddc221cb102 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:10.242611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 708/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:19.510894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=67 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:20.239734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=61 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:23.806449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243757f2-f474-4513-9c58-1355ebe4098c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:23.807008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243757f2-f474-4513-9c58-1355ebe4098c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:23.807008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243757f2-f474-4513-9c58-1355ebe4098c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:23.808360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 702/1410] 10.222.0.52 () {54 vars in 918 bytes} [Sun Sep 25 04:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:23.813660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846056-db20-4528-a0dd-c586787efc52 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:23.814816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846056-db20-4528-a0dd-c586787efc52 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:23.814816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846056-db20-4528-a0dd-c586787efc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:23.890018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-df846056-db20-4528-a0dd-c586787efc52 None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:23.891266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-df846056-db20-4528-a0dd-c586787efc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:23.996168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 709/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 25 04:29:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:24.010474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13705a2c-5ec9-4a54-aa68-684459c3db8e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:24.010757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13705a2c-5ec9-4a54-aa68-684459c3db8e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:24.011032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13705a2c-5ec9-4a54-aa68-684459c3db8e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:24.012355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 703/1412] 10.222.0.52 () {54 vars in 918 bytes} [Sun Sep 25 04:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:24.017675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d1df-5c65-48cd-8dd0-1b419ad165b8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:24.017965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d1df-5c65-48cd-8dd0-1b419ad165b8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:24.018246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d1df-5c65-48cd-8dd0-1b419ad165b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:24.089860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:24.092930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-89b7d1df-5c65-48cd-8dd0-1b419ad165b8 None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:24.094812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-89b7d1df-5c65-48cd-8dd0-1b419ad165b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:24.209109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 710/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 25 04:29:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:26.781251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ea3c-06c3-488d-825d-079f0bd7409a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:26.781791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ea3c-06c3-488d-825d-079f0bd7409a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:26.781791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ea3c-06c3-488d-825d-079f0bd7409a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:26.783817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:26.789063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4fad-e2e6-4d63-8bc8-b887b161fcf3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:26.789482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4fad-e2e6-4d63-8bc8-b887b161fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:26.789616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4fad-e2e6-4d63-8bc8-b887b161fcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:26.855859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c89c4fad-e2e6-4d63-8bc8-b887b161fcf3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:26.857075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c89c4fad-e2e6-4d63-8bc8-b887b161fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:26.912383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:26.953855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:27.247128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67ea3c-06c3-488d-825d-079f0bd7409a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:27.248648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1c67ea3c-06c3-488d-825d-079f0bd7409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:27.393095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67ea3c-06c3-488d-825d-079f0bd7409a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:27.464077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:27.503650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1adda9-7d70-47e7-824b-d7358d6a0b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:27.504187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1adda9-7d70-47e7-824b-d7358d6a0b41 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:27.504463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1adda9-7d70-47e7-824b-d7358d6a0b41 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:27.504732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1adda9-7d70-47e7-824b-d7358d6a0b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:27.506313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6e1adda9-7d70-47e7-824b-d7358d6a0b41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:27.594653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1adda9-7d70-47e7-824b-d7358d6a0b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:27.596238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1adda9-7d70-47e7-824b-d7358d6a0b41 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:27.614160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 705/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:28.750038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7b5d-a155-490f-bfe4-3c4ce8ceb158 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:28.750597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7b5d-a155-490f-bfe4-3c4ce8ceb158 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:28.750597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7b5d-a155-490f-bfe4-3c4ce8ceb158 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:28.752497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:28.758774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4db9ff-2c64-42a5-bec5-ce9caff1580b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:28.759224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4db9ff-2c64-42a5-bec5-ce9caff1580b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:28.759341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4db9ff-2c64-42a5-bec5-ce9caff1580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:28.834997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ce4db9ff-2c64-42a5-bec5-ce9caff1580b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:28.836223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ce4db9ff-2c64-42a5-bec5-ce9caff1580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:28.862543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:28.934986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:29.085826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d7b5d-a155-490f-bfe4-3c4ce8ceb158 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:29.087374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b7d7b5d-a155-490f-bfe4-3c4ce8ceb158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:29.232980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d7b5d-a155-490f-bfe4-3c4ce8ceb158 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:29.273113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:29.344170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c450573-0ab4-4c26-8011-07164def7b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:29.344768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c450573-0ab4-4c26-8011-07164def7b05 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:29.345044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c450573-0ab4-4c26-8011-07164def7b05 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:29.345891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c450573-0ab4-4c26-8011-07164def7b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:29.347517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6c450573-0ab4-4c26-8011-07164def7b05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:29.434497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c450573-0ab4-4c26-8011-07164def7b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:29.436323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c450573-0ab4-4c26-8011-07164def7b05 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:29.454168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 713/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:30.597062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a939-5a0b-415b-91a5-8e254c1bae15 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:30.597657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a939-5a0b-415b-91a5-8e254c1bae15 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:30.597657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a939-5a0b-415b-91a5-8e254c1bae15 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:30.599010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:30.605337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959aa5f-774e-4c98-b8d9-fb6f2122d632 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:30.605762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959aa5f-774e-4c98-b8d9-fb6f2122d632 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:30.605881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959aa5f-774e-4c98-b8d9-fb6f2122d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:30.659356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:30.681763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d959aa5f-774e-4c98-b8d9-fb6f2122d632 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:30.682477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d959aa5f-774e-4c98-b8d9-fb6f2122d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:30.783786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:30.936098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a939-5a0b-415b-91a5-8e254c1bae15 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:30.937624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c98a939-5a0b-415b-91a5-8e254c1bae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:31.081292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a939-5a0b-415b-91a5-8e254c1bae15 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:31.093640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:31.194044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25b584-76da-452d-9c0b-0299d0d9c5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:31.194604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b584-76da-452d-9c0b-0299d0d9c5ea service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:31.194878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b584-76da-452d-9c0b-0299d0d9c5ea service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:31.195147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b584-76da-452d-9c0b-0299d0d9c5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:31.196753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd25b584-76da-452d-9c0b-0299d0d9c5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:31.284753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25b584-76da-452d-9c0b-0299d0d9c5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:31.286390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25b584-76da-452d-9c0b-0299d0d9c5ea service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:31.304481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 708/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:32.398459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d04a-14db-4351-aa41-a3469114acf6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:32.398993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d04a-14db-4351-aa41-a3469114acf6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:32.398993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d04a-14db-4351-aa41-a3469114acf6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:32.400387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:32.406438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd073-f441-431c-be5f-fea4f69a84c4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:32.406825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd073-f441-431c-be5f-fea4f69a84c4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:32.406990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd073-f441-431c-be5f-fea4f69a84c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:32.426271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:32.481938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-491cd073-f441-431c-be5f-fea4f69a84c4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:32.483181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-491cd073-f441-431c-be5f-fea4f69a84c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:32.579798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:29:32.731272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d04a-14db-4351-aa41-a3469114acf6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:32.732820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7ac8d04a-14db-4351-aa41-a3469114acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:32.843423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:32.879598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d04a-14db-4351-aa41-a3469114acf6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:32.996005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2553fcb-53e0-4c08-9764-efda7aa791de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:32.996617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553fcb-53e0-4c08-9764-efda7aa791de service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:32.996897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553fcb-53e0-4c08-9764-efda7aa791de service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:32.997171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553fcb-53e0-4c08-9764-efda7aa791de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:32.998800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e2553fcb-53e0-4c08-9764-efda7aa791de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:33.074462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:33.088016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2553fcb-53e0-4c08-9764-efda7aa791de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:33.089617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2553fcb-53e0-4c08-9764-efda7aa791de service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:33.108296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 716/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:34.226713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7566-91b3-4e03-9c67-a39d30e8cddb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:34.227367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7566-91b3-4e03-9c67-a39d30e8cddb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:34.227367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7566-91b3-4e03-9c67-a39d30e8cddb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:34.228622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:34.235105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ea16b-4416-4444-aec5-c63494f04773 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:34.235592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ea16b-4416-4444-aec5-c63494f04773 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:34.235731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ea16b-4416-4444-aec5-c63494f04773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:34.320499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5c3ea16b-4416-4444-aec5-c63494f04773 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:34.321872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5c3ea16b-4416-4444-aec5-c63494f04773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:34.423922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:34.575400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d7566-91b3-4e03-9c67-a39d30e8cddb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:34.576855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-693d7566-91b3-4e03-9c67-a39d30e8cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:34.666369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:34.730014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d7566-91b3-4e03-9c67-a39d30e8cddb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:34.842560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a64c7-8416-4d5e-bd9c-becd5a7adef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:34.843088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a64c7-8416-4d5e-bd9c-becd5a7adef4 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:34.843362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a64c7-8416-4d5e-bd9c-becd5a7adef4 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:34.843632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a64c7-8416-4d5e-bd9c-becd5a7adef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:34.845227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c72a64c7-8416-4d5e-bd9c-becd5a7adef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:34.893409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:34.940472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a64c7-8416-4d5e-bd9c-becd5a7adef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:34.943067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a64c7-8416-4d5e-bd9c-becd5a7adef4 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:34.963441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 711/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:36.015208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987a7a-13d5-4553-9f68-4b753823892c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:36.015787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987a7a-13d5-4553-9f68-4b753823892c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:36.015787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987a7a-13d5-4553-9f68-4b753823892c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:36.017093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:36.023657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1797f-7ad8-4ceb-88f2-9539499551db None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:36.024082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1797f-7ad8-4ceb-88f2-9539499551db None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:36.024216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1797f-7ad8-4ceb-88f2-9539499551db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:36.099597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d3b1797f-7ad8-4ceb-88f2-9539499551db None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:36.100811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d3b1797f-7ad8-4ceb-88f2-9539499551db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:36.195244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:36.345546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987a7a-13d5-4553-9f68-4b753823892c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:36.347027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3e987a7a-13d5-4553-9f68-4b753823892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:36.395254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:36.498159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987a7a-13d5-4553-9f68-4b753823892c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:36.609690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c642c63-45b6-466b-b15a-000b55273c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:36.610214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c642c63-45b6-466b-b15a-000b55273c23 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:36.610537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c642c63-45b6-466b-b15a-000b55273c23 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:36.610813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c642c63-45b6-466b-b15a-000b55273c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:36.612921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3c642c63-45b6-466b-b15a-000b55273c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:36.619784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:36.702584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c642c63-45b6-466b-b15a-000b55273c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:36.704193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c642c63-45b6-466b-b15a-000b55273c23 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:36.722961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 719/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:37.760593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd984-5543-4d31-a554-8e4ec595d4d5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:37.761168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd984-5543-4d31-a554-8e4ec595d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:37.761168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd984-5543-4d31-a554-8e4ec595d4d5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:37.762507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:37.768521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff072f-ac82-4548-ade4-3b5a092e0470 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:37.768939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff072f-ac82-4548-ade4-3b5a092e0470 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:37.769080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff072f-ac82-4548-ade4-3b5a092e0470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:37.844646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-83ff072f-ac82-4548-ade4-3b5a092e0470 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:37.846385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-83ff072f-ac82-4548-ade4-3b5a092e0470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:37.912639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:37.941878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:38.089081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd984-5543-4d31-a554-8e4ec595d4d5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:38.090589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f0bd984-5543-4d31-a554-8e4ec595d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:38.108288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:38.232265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd984-5543-4d31-a554-8e4ec595d4d5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:38.317767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:38.343740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd6db5-a591-4520-8bf0-e322d555bd27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:38.344288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd6db5-a591-4520-8bf0-e322d555bd27 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:38.344564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd6db5-a591-4520-8bf0-e322d555bd27 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:38.344836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd6db5-a591-4520-8bf0-e322d555bd27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:38.347083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-14bd6db5-a591-4520-8bf0-e322d555bd27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:38.433703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd6db5-a591-4520-8bf0-e322d555bd27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:38.435311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd6db5-a591-4520-8bf0-e322d555bd27 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:38.453526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 714/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:39.509138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df3227-f421-47c6-a2ef-31455b6a95f3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:39.509692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df3227-f421-47c6-a2ef-31455b6a95f3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:39.509692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df3227-f421-47c6-a2ef-31455b6a95f3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:39.511079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:39.517212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f83015-0dea-4daf-aa8a-7fb4472a43c2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:39.518231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f83015-0dea-4daf-aa8a-7fb4472a43c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:39.518231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f83015-0dea-4daf-aa8a-7fb4472a43c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:39.602584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b8f83015-0dea-4daf-aa8a-7fb4472a43c2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:39.603824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b8f83015-0dea-4daf-aa8a-7fb4472a43c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:39.645207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:39.699366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:39.852630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df3227-f421-47c6-a2ef-31455b6a95f3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:39.854174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-27df3227-f421-47c6-a2ef-31455b6a95f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:40.001481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df3227-f421-47c6-a2ef-31455b6a95f3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:40.053888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:40.111497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aca0e0-0207-412c-861d-ac45004ecb8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:40.112034 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aca0e0-0207-412c-861d-ac45004ecb8c service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:40.112310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aca0e0-0207-412c-861d-ac45004ecb8c service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:40.112581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aca0e0-0207-412c-861d-ac45004ecb8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:40.114168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-25aca0e0-0207-412c-861d-ac45004ecb8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:40.200991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aca0e0-0207-412c-861d-ac45004ecb8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:40.202612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aca0e0-0207-412c-861d-ac45004ecb8c service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:40.220616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 722/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:29:41.272088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee961c-e337-4230-a591-862413b8c323 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:41.272522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee961c-e337-4230-a591-862413b8c323 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:41.272625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee961c-e337-4230-a591-862413b8c323 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:41.273973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:41.280154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e5d1-1b03-4ada-9826-571422d7a46f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:41.280552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e5d1-1b03-4ada-9826-571422d7a46f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:41.280714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e5d1-1b03-4ada-9826-571422d7a46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:41.359939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8dd6e5d1-1b03-4ada-9826-571422d7a46f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:41.361710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8dd6e5d1-1b03-4ada-9826-571422d7a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:41.363781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:41.456930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:41.612022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee961c-e337-4230-a591-862413b8c323 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:41.613483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-49ee961c-e337-4230-a591-862413b8c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:41.758876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee961c-e337-4230-a591-862413b8c323 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:41.786121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:41.870958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65275b-3b2b-4837-ac60-b11cf12d29f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:41.871600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65275b-3b2b-4837-ac60-b11cf12d29f7 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:41.871874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65275b-3b2b-4837-ac60-b11cf12d29f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:41.872139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65275b-3b2b-4837-ac60-b11cf12d29f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:41.873739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3c65275b-3b2b-4837-ac60-b11cf12d29f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:41.975426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65275b-3b2b-4837-ac60-b11cf12d29f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:41.977023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65275b-3b2b-4837-ac60-b11cf12d29f7 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:41.995215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 717/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:44.052440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95abb2-32ad-4001-a6e5-b061d68c7b25 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:44.052968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95abb2-32ad-4001-a6e5-b061d68c7b25 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:44.052968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95abb2-32ad-4001-a6e5-b061d68c7b25 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:44.054401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:44.059834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b8c95-8683-4aa6-8254-0c01888b9ea0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:44.060251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b8c95-8683-4aa6-8254-0c01888b9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:44.060393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b8c95-8683-4aa6-8254-0c01888b9ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:44.101383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:44.128294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5d0b8c95-8683-4aa6-8254-0c01888b9ea0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:44.129514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d0b8c95-8683-4aa6-8254-0c01888b9ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:44.226131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:44.509354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95abb2-32ad-4001-a6e5-b061d68c7b25 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:44.510948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1d95abb2-32ad-4001-a6e5-b061d68c7b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:44.612772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95abb2-32ad-4001-a6e5-b061d68c7b25 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:44.645183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:44.686039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830368f-e8d0-48e5-b576-5640caef3545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:44.686936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830368f-e8d0-48e5-b576-5640caef3545 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:44.687219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830368f-e8d0-48e5-b576-5640caef3545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:44.687496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830368f-e8d0-48e5-b576-5640caef3545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:44.689099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d830368f-e8d0-48e5-b576-5640caef3545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:44.801946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830368f-e8d0-48e5-b576-5640caef3545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:44.803350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830368f-e8d0-48e5-b576-5640caef3545 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:44.822047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 725/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:47.104069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2aa61-bc60-4736-8280-8c7a67bf7dd1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:47.104617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2aa61-bc60-4736-8280-8c7a67bf7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:47.104617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2aa61-bc60-4736-8280-8c7a67bf7dd1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:47.105965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:47.111909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b121a4-bd25-4fe0-af85-f4c407dc6011 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:47.112348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b121a4-bd25-4fe0-af85-f4c407dc6011 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:47.112460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b121a4-bd25-4fe0-af85-f4c407dc6011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:47.178783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-72b121a4-bd25-4fe0-af85-f4c407dc6011 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:47.180006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-72b121a4-bd25-4fe0-af85-f4c407dc6011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:47.192761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:47.276814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:47.556015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2aa61-bc60-4736-8280-8c7a67bf7dd1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:47.557555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3d2aa61-bc60-4736-8280-8c7a67bf7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:47.658586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2aa61-bc60-4736-8280-8c7a67bf7dd1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:47.671157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:47.730912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dda8b-0be6-4184-9ab9-9dbd93117960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:47.731516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dda8b-0be6-4184-9ab9-9dbd93117960 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:47.731798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dda8b-0be6-4184-9ab9-9dbd93117960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:47.732072 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dda8b-0be6-4184-9ab9-9dbd93117960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:47.733666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-308dda8b-0be6-4184-9ab9-9dbd93117960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:47.840293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dda8b-0be6-4184-9ab9-9dbd93117960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:47.841653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dda8b-0be6-4184-9ab9-9dbd93117960 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:47.859987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 720/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:50.368321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f654c7-5afe-42bf-8023-4d636d39f8d5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:50.368887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f654c7-5afe-42bf-8023-4d636d39f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:50.368887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f654c7-5afe-42bf-8023-4d636d39f8d5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:50.370201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:50.375623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db804ac-fe76-4816-8daf-e4b5d3df8802 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:50.376023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db804ac-fe76-4816-8daf-e4b5d3df8802 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:50.376203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db804ac-fe76-4816-8daf-e4b5d3df8802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:50.425316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:50.443680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5db804ac-fe76-4816-8daf-e4b5d3df8802 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:50.444907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5db804ac-fe76-4816-8daf-e4b5d3df8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:50.540724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:50.822988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f654c7-5afe-42bf-8023-4d636d39f8d5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:50.824609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-54f654c7-5afe-42bf-8023-4d636d39f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:50.927642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f654c7-5afe-42bf-8023-4d636d39f8d5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:50.967883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:51.002908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87189e39-9d17-4dfa-a731-15e6171edd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:51.003509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189e39-9d17-4dfa-a731-15e6171edd7c service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:51.003784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189e39-9d17-4dfa-a731-15e6171edd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:51.004051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189e39-9d17-4dfa-a731-15e6171edd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:51.005644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-87189e39-9d17-4dfa-a731-15e6171edd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:51.115311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87189e39-9d17-4dfa-a731-15e6171edd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:51.116696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87189e39-9d17-4dfa-a731-15e6171edd7c service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:51.134239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 728/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:53.423746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac39da-63d2-4fb7-b876-6c1f3df82811 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:53.424326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac39da-63d2-4fb7-b876-6c1f3df82811 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:53.424326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac39da-63d2-4fb7-b876-6c1f3df82811 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:53.425644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:53.430954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696eac9-b29d-4093-a4f6-7da88ad897cf None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:53.431406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696eac9-b29d-4093-a4f6-7da88ad897cf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:53.431513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696eac9-b29d-4093-a4f6-7da88ad897cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:53.496865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c696eac9-b29d-4093-a4f6-7da88ad897cf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:53.498078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c696eac9-b29d-4093-a4f6-7da88ad897cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:53.519441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:53.597381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:53.881409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac39da-63d2-4fb7-b876-6c1f3df82811 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:53.882990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-73ac39da-63d2-4fb7-b876-6c1f3df82811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:53.986107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac39da-63d2-4fb7-b876-6c1f3df82811 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:54.007617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:54.060283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5aa0c-3588-430d-b688-fad3549e96f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:54.060895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5aa0c-3588-430d-b688-fad3549e96f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:54.061175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5aa0c-3588-430d-b688-fad3549e96f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:54.061451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5aa0c-3588-430d-b688-fad3549e96f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:54.063362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a2e5aa0c-3588-430d-b688-fad3549e96f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:54.170864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5aa0c-3588-430d-b688-fad3549e96f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:54.172233 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5aa0c-3588-430d-b688-fad3549e96f9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:54.190765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 723/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:56.378421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db347-1c50-4530-8572-639456f80830 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:56.378948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db347-1c50-4530-8572-639456f80830 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:56.379045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db347-1c50-4530-8572-639456f80830 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:56.380339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:56.385781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18f074-fbe3-4c76-af8e-6488ac74a411 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:56.386200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18f074-fbe3-4c76-af8e-6488ac74a411 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:56.386328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18f074-fbe3-4c76-af8e-6488ac74a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:56.449405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:56.452133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5d18f074-fbe3-4c76-af8e-6488ac74a411 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:56.453912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d18f074-fbe3-4c76-af8e-6488ac74a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:56.549546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:56.834616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db347-1c50-4530-8572-639456f80830 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:56.836183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-130db347-1c50-4530-8572-639456f80830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:56.946482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db347-1c50-4530-8572-639456f80830 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:57.007251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:57.033549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0b3d7-0a21-45d5-a818-28e863e1baa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:29:57.034170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b3d7-0a21-45d5-a818-28e863e1baa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:57.034497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b3d7-0a21-45d5-a818-28e863e1baa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:57.034778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b3d7-0a21-45d5-a818-28e863e1baa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:57.036395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-52f0b3d7-0a21-45d5-a818-28e863e1baa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:57.150458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0b3d7-0a21-45d5-a818-28e863e1baa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:29:57.151911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0b3d7-0a21-45d5-a818-28e863e1baa8 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:29:57.170566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 731/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:59.364452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816deb-ef1a-41ff-b77a-56025c3561c1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:59.365004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816deb-ef1a-41ff-b77a-56025c3561c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:59.365004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816deb-ef1a-41ff-b77a-56025c3561c1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:59.366340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:29:59.371679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ce47-9f96-4ef0-b7bb-e17a7fe3edd0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:29:59.372101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ce47-9f96-4ef0-b7bb-e17a7fe3edd0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:29:59.372240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ce47-9f96-4ef0-b7bb-e17a7fe3edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:29:59.437613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-79a9ce47-9f96-4ef0-b7bb-e17a7fe3edd0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:29:59.438849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-79a9ce47-9f96-4ef0-b7bb-e17a7fe3edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:59.468407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:59.538140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:29:59.824355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816deb-ef1a-41ff-b77a-56025c3561c1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:29:59.825908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-01816deb-ef1a-41ff-b77a-56025c3561c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:29:59.928167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816deb-ef1a-41ff-b77a-56025c3561c1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:29:59.956618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:00.000614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31822b-f822-42ed-9d43-d3ecfb5748d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:00.001222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31822b-f822-42ed-9d43-d3ecfb5748d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:00.001497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31822b-f822-42ed-9d43-d3ecfb5748d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:00.001768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31822b-f822-42ed-9d43-d3ecfb5748d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:00.003990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ae31822b-f822-42ed-9d43-d3ecfb5748d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:00.112087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31822b-f822-42ed-9d43-d3ecfb5748d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:00.113449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31822b-f822-42ed-9d43-d3ecfb5748d8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:00.131918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 726/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:02.409314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2e05a-bb5e-4fe8-bf6b-2e40f0ade024 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:02.409859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2e05a-bb5e-4fe8-bf6b-2e40f0ade024 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:02.409859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2e05a-bb5e-4fe8-bf6b-2e40f0ade024 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:02.411293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:02.416517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17caf40-8d6c-408e-9ae9-3c75cc0dca29 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:02.416891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17caf40-8d6c-408e-9ae9-3c75cc0dca29 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:02.417073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17caf40-8d6c-408e-9ae9-3c75cc0dca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:02.484239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f17caf40-8d6c-408e-9ae9-3c75cc0dca29 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:02.486283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f17caf40-8d6c-408e-9ae9-3c75cc0dca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:02.494976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:02.582489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:02.863743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2e05a-bb5e-4fe8-bf6b-2e40f0ade024 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:02.865297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-76e2e05a-bb5e-4fe8-bf6b-2e40f0ade024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:02.967693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2e05a-bb5e-4fe8-bf6b-2e40f0ade024 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:03.022472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:03.040151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ae7c-5afa-4fd6-9bc6-c3db0f94a9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:03.040757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ae7c-5afa-4fd6-9bc6-c3db0f94a9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:03.041038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ae7c-5afa-4fd6-9bc6-c3db0f94a9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:03.041310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ae7c-5afa-4fd6-9bc6-c3db0f94a9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:03.042941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b8f1ae7c-5afa-4fd6-9bc6-c3db0f94a9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:03.151785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ae7c-5afa-4fd6-9bc6-c3db0f94a9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:03.153219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ae7c-5afa-4fd6-9bc6-c3db0f94a9b5 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:03.171379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 734/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:05.393298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b90f9-73ce-4be4-95e5-5ebc0638c1ac None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:05.393900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b90f9-73ce-4be4-95e5-5ebc0638c1ac None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:05.393900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b90f9-73ce-4be4-95e5-5ebc0638c1ac None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:05.395222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:05.400582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209b91-bdd7-4c98-bdc6-4b7b5f47bcd2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:05.401024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209b91-bdd7-4c98-bdc6-4b7b5f47bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:05.401138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209b91-bdd7-4c98-bdc6-4b7b5f47bcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:05.472351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b6209b91-bdd7-4c98-bdc6-4b7b5f47bcd2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:05.473594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b6209b91-bdd7-4c98-bdc6-4b7b5f47bcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:05.511776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:05.572338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:05.860911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b90f9-73ce-4be4-95e5-5ebc0638c1ac None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:05.863025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d72b90f9-73ce-4be4-95e5-5ebc0638c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:05.964975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b90f9-73ce-4be4-95e5-5ebc0638c1ac None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:06.001467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:06.036669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad68dd3-f13f-45d6-bf08-438aabb65c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:06.037265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad68dd3-f13f-45d6-bf08-438aabb65c9a service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:06.037537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad68dd3-f13f-45d6-bf08-438aabb65c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:06.037803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad68dd3-f13f-45d6-bf08-438aabb65c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:06.039409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8ad68dd3-f13f-45d6-bf08-438aabb65c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:06.150430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad68dd3-f13f-45d6-bf08-438aabb65c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:06.151878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad68dd3-f13f-45d6-bf08-438aabb65c9a service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:06.170009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 729/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:30:08.323377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df74ae-de93-47dd-83ab-b98c6b71cf2b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:08.323908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df74ae-de93-47dd-83ab-b98c6b71cf2b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:08.324019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df74ae-de93-47dd-83ab-b98c6b71cf2b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:08.325326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:08.330606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a07e5-a6a3-44d3-b8a0-048dcd69ab67 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:08.331008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a07e5-a6a3-44d3-b8a0-048dcd69ab67 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:08.331206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a07e5-a6a3-44d3-b8a0-048dcd69ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:08.396337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-644a07e5-a6a3-44d3-b8a0-048dcd69ab67 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:08.397558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-644a07e5-a6a3-44d3-b8a0-048dcd69ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:08.416716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:08.504718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:08.792747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df74ae-de93-47dd-83ab-b98c6b71cf2b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:08.794307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-81df74ae-de93-47dd-83ab-b98c6b71cf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:08.896705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df74ae-de93-47dd-83ab-b98c6b71cf2b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:09.079737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:09.086592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8c3e0-1745-4d4f-be83-b353053dce5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:09.087197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c3e0-1745-4d4f-be83-b353053dce5c service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:09.087473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c3e0-1745-4d4f-be83-b353053dce5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:09.087742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c3e0-1745-4d4f-be83-b353053dce5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:09.089338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6bd8c3e0-1745-4d4f-be83-b353053dce5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:09.197443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8c3e0-1745-4d4f-be83-b353053dce5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:09.198916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8c3e0-1745-4d4f-be83-b353053dce5c service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:09.216570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 737/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:11.393668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf58e9-92d3-4fb3-afef-833a7478d596 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:11.394225 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf58e9-92d3-4fb3-afef-833a7478d596 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:11.394225 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf58e9-92d3-4fb3-afef-833a7478d596 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:11.395605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:11.401002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f849a6-55d3-4a93-8fec-298c2fb8f067 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:11.401422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f849a6-55d3-4a93-8fec-298c2fb8f067 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:11.401541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f849a6-55d3-4a93-8fec-298c2fb8f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:11.467337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-38f849a6-55d3-4a93-8fec-298c2fb8f067 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:11.468562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-38f849a6-55d3-4a93-8fec-298c2fb8f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:11.515435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:11.563685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:11.844803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf58e9-92d3-4fb3-afef-833a7478d596 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:11.846953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ccf58e9-92d3-4fb3-afef-833a7478d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:11.947874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf58e9-92d3-4fb3-afef-833a7478d596 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:11.997082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:12.023264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81be3bb-069e-4ae3-ba91-1148d64017ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:12.023860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81be3bb-069e-4ae3-ba91-1148d64017ea service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:12.024135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81be3bb-069e-4ae3-ba91-1148d64017ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:12.024400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81be3bb-069e-4ae3-ba91-1148d64017ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:12.025987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e81be3bb-069e-4ae3-ba91-1148d64017ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:12.132048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81be3bb-069e-4ae3-ba91-1148d64017ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:12.133489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81be3bb-069e-4ae3-ba91-1148d64017ea service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:12.152076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 732/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:21.561960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=22 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:22.149770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=66 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:32.069255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e5ae-e8b6-46a7-af3c-c47c0f4704b5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:32.069777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e5ae-e8b6-46a7-af3c-c47c0f4704b5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:32.069777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e5ae-e8b6-46a7-af3c-c47c0f4704b5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:32.071111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 739/1471] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:32.076300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26166e-daad-47b5-aaa6-962e49f31014 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:32.076735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26166e-daad-47b5-aaa6-962e49f31014 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:32.076849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26166e-daad-47b5-aaa6-962e49f31014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:32.141661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bc26166e-daad-47b5-aaa6-962e49f31014 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:32.143385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bc26166e-daad-47b5-aaa6-962e49f31014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:32.239252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 733/1472] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:30:32.535675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85e0a-f6a5-456d-ac5f-49ea8d394a24 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:32.535961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85e0a-f6a5-456d-ac5f-49ea8d394a24 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:32.536235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85e0a-f6a5-456d-ac5f-49ea8d394a24 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:32.537553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 740/1473] 10.222.0.52 () {54 vars in 962 bytes} [Sun Sep 25 04:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:30:32.542476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649767c6-1c9b-4c4c-839e-ec0f23d1c2f9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:32.542770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649767c6-1c9b-4c4c-839e-ec0f23d1c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:32.543048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649767c6-1c9b-4c4c-839e-ec0f23d1c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:32.618915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-649767c6-1c9b-4c4c-839e-ec0f23d1c2f9 None None] MFA Rules not processed for user `78f639af7ae54e06b8baa10e77236c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:32.620114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-649767c6-1c9b-4c4c-839e-ec0f23d1c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:32.639791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:32.694744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 734/1474] 10.222.0.52 () {58 vars in 1059 bytes} [Sun Sep 25 04:30:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:32.702632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f85e0a-f6a5-456d-ac5f-49ea8d394a24 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:32.704163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-75f85e0a-f6a5-456d-ac5f-49ea8d394a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:32.807275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f85e0a-f6a5-456d-ac5f-49ea8d394a24 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:32.879168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14e72e-70cb-45f4-a3f6-ff5aede2bee9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:32.879770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e72e-70cb-45f4-a3f6-ff5aede2bee9 service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:32.880045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e72e-70cb-45f4-a3f6-ff5aede2bee9 service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:32.880315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e72e-70cb-45f4-a3f6-ff5aede2bee9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:32.881898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cf14e72e-70cb-45f4-a3f6-ff5aede2bee9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:32.935217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:32.989709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14e72e-70cb-45f4-a3f6-ff5aede2bee9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:32.991175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14e72e-70cb-45f4-a3f6-ff5aede2bee9 service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:33.009791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 741/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:35.238797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e578f-c575-400f-9bb4-36577e2bf054 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:35.239347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e578f-c575-400f-9bb4-36577e2bf054 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:35.239347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e578f-c575-400f-9bb4-36577e2bf054 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:35.240683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 735/1476] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:35.246181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941674e-6975-41dc-a924-b1a40d2b1750 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:35.246663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941674e-6975-41dc-a924-b1a40d2b1750 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:35.246780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941674e-6975-41dc-a924-b1a40d2b1750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:35.315972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0941674e-6975-41dc-a924-b1a40d2b1750 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:35.317079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0941674e-6975-41dc-a924-b1a40d2b1750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:35.418867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 742/1477] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:35.708159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e578f-c575-400f-9bb4-36577e2bf054 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:35.709711 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e9e578f-c575-400f-9bb4-36577e2bf054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:35.835880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e578f-c575-400f-9bb4-36577e2bf054 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:35.885417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:35.936149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3df5-93c7-4d35-ae53-e59cf8706dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:35.936766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3df5-93c7-4d35-ae53-e59cf8706dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:35.937045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3df5-93c7-4d35-ae53-e59cf8706dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:35.937319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3df5-93c7-4d35-ae53-e59cf8706dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:35.937960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3df5-93c7-4d35-ae53-e59cf8706dd6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:35.940723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-c88e3df5-93c7-4d35-ae53-e59cf8706dd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:30:35.940723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:30:35.940723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:30:35.941886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3df5-93c7-4d35-ae53-e59cf8706dd6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:35.961725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 736/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Sep 25 04:30:35 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:30:38.169355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b11e3-0c2e-4196-bc6c-102c84798919 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:38.169886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b11e3-0c2e-4196-bc6c-102c84798919 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:38.169886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b11e3-0c2e-4196-bc6c-102c84798919 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:38.171295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 743/1479] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:38.176559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c10833-fed5-4f2d-b2f1-1d1f553903e2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:38.177001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c10833-fed5-4f2d-b2f1-1d1f553903e2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:38.177113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c10833-fed5-4f2d-b2f1-1d1f553903e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:38.243360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-98c10833-fed5-4f2d-b2f1-1d1f553903e2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:38.244575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-98c10833-fed5-4f2d-b2f1-1d1f553903e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:38.341067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 737/1480] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:38.636215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b11e3-0c2e-4196-bc6c-102c84798919 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:38.637770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-483b11e3-0c2e-4196-bc6c-102c84798919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:38.647530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:38.782796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b11e3-0c2e-4196-bc6c-102c84798919 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:38.864029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:38.897439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a2dbb-d0c6-4d81-8873-540d3cc8e652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:38.897975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a2dbb-d0c6-4d81-8873-540d3cc8e652 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:38.898256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a2dbb-d0c6-4d81-8873-540d3cc8e652 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:38.898593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a2dbb-d0c6-4d81-8873-540d3cc8e652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:38.900194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c56a2dbb-d0c6-4d81-8873-540d3cc8e652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:39.005068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a2dbb-d0c6-4d81-8873-540d3cc8e652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:39.008578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a2dbb-d0c6-4d81-8873-540d3cc8e652 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:39.030816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 744/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:41.437799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2a9f-cd7a-4cba-88c9-ace8a56d1f3d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:41.438329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2a9f-cd7a-4cba-88c9-ace8a56d1f3d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:41.438329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2a9f-cd7a-4cba-88c9-ace8a56d1f3d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:41.440674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 738/1482] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:41.445994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51b9bf-44b4-458b-ae2d-24200470ece1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:41.446478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51b9bf-44b4-458b-ae2d-24200470ece1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:41.446577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51b9bf-44b4-458b-ae2d-24200470ece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:41.517092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0b51b9bf-44b4-458b-ae2d-24200470ece1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:41.518459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0b51b9bf-44b4-458b-ae2d-24200470ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:41.566814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:41.618730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 745/1483] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:41.905311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2a9f-cd7a-4cba-88c9-ace8a56d1f3d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:41.906992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d1da2a9f-cd7a-4cba-88c9-ace8a56d1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:41.931955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:42.022796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2a9f-cd7a-4cba-88c9-ace8a56d1f3d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:42.101300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80036-bd1a-4213-a2e6-6ee6aa01bb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:42.101915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80036-bd1a-4213-a2e6-6ee6aa01bb3c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:42.102193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80036-bd1a-4213-a2e6-6ee6aa01bb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:42.102510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80036-bd1a-4213-a2e6-6ee6aa01bb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:42.104124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08b80036-bd1a-4213-a2e6-6ee6aa01bb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:42.184102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:42.220682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b80036-bd1a-4213-a2e6-6ee6aa01bb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:42.222685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b80036-bd1a-4213-a2e6-6ee6aa01bb3c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:42.242187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 739/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:44.463615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46f36-7471-4cf7-8b2a-9fc6abe9da61 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:44.464175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46f36-7471-4cf7-8b2a-9fc6abe9da61 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:44.464175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46f36-7471-4cf7-8b2a-9fc6abe9da61 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:44.465583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 746/1485] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:44.471394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab17bc-430b-4ac0-852c-a8d1870983d7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:44.471836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab17bc-430b-4ac0-852c-a8d1870983d7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:44.471928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab17bc-430b-4ac0-852c-a8d1870983d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:44.540243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1cab17bc-430b-4ac0-852c-a8d1870983d7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:44.541497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1cab17bc-430b-4ac0-852c-a8d1870983d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:44.642739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 740/1486] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:44.935637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46f36-7471-4cf7-8b2a-9fc6abe9da61 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:44.937215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2bf46f36-7471-4cf7-8b2a-9fc6abe9da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:45.047712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46f36-7471-4cf7-8b2a-9fc6abe9da61 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:45.126602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:45.128721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d216f4-ff25-4c66-8a71-17e13820d7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:45.129522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d216f4-ff25-4c66-8a71-17e13820d7cc service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:45.129808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d216f4-ff25-4c66-8a71-17e13820d7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:45.130437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d216f4-ff25-4c66-8a71-17e13820d7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:45.132548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-01d216f4-ff25-4c66-8a71-17e13820d7cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:45.251587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d216f4-ff25-4c66-8a71-17e13820d7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:45.253475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d216f4-ff25-4c66-8a71-17e13820d7cc service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:45.273065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 747/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:47.503708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b58ec-25d7-426f-8d76-39e76f10340f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:47.504267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b58ec-25d7-426f-8d76-39e76f10340f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:47.504267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b58ec-25d7-426f-8d76-39e76f10340f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:47.505635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 741/1488] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:47.511229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa38d5-d65a-4a1d-b3ce-3967fb889db4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:47.511649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa38d5-d65a-4a1d-b3ce-3967fb889db4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:47.511777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa38d5-d65a-4a1d-b3ce-3967fb889db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:47.584074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e5aa38d5-d65a-4a1d-b3ce-3967fb889db4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:47.585303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e5aa38d5-d65a-4a1d-b3ce-3967fb889db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:47.639414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:47.684022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 748/1489] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:47.978520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b58ec-25d7-426f-8d76-39e76f10340f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:47.980091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-338b58ec-25d7-426f-8d76-39e76f10340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:48.016316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:48.085145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b58ec-25d7-426f-8d76-39e76f10340f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:48.158154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e721-93a3-47d2-97da-2b4d03ca2c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:48.159324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e721-93a3-47d2-97da-2b4d03ca2c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:48.159594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e721-93a3-47d2-97da-2b4d03ca2c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:48.159857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e721-93a3-47d2-97da-2b4d03ca2c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:48.161443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5e96e721-93a3-47d2-97da-2b4d03ca2c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:48.240899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:48.270092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e721-93a3-47d2-97da-2b4d03ca2c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:48.271592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e721-93a3-47d2-97da-2b4d03ca2c64 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:48.289625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 742/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:30:50.609503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9931-3248-480e-a9bf-410457990172 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:50.610051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9931-3248-480e-a9bf-410457990172 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:50.610051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9931-3248-480e-a9bf-410457990172 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:50.611352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 749/1491] 10.222.0.52 () {54 vars in 927 bytes} [Sun Sep 25 04:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:30:50.616655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce6fa-4d63-44c4-9a33-2bd97643789a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:50.617042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce6fa-4d63-44c4-9a33-2bd97643789a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:50.617201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce6fa-4d63-44c4-9a33-2bd97643789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:50.681172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a1fce6fa-4d63-44c4-9a33-2bd97643789a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:30:50.682391 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1fce6fa-4d63-44c4-9a33-2bd97643789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:50.776218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 743/1492] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Sep 25 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:30:51.063695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9931-3248-480e-a9bf-410457990172 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:30:51.065570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-797d9931-3248-480e-a9bf-410457990172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:51.169212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9931-3248-480e-a9bf-410457990172 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:30:51.242547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed681f-a645-4998-bbf7-f091ddd9aad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:30:51.243159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed681f-a645-4998-bbf7-f091ddd9aad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:30:51.243440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed681f-a645-4998-bbf7-f091ddd9aad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:30:51.243712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed681f-a645-4998-bbf7-f091ddd9aad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:30:51.245300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f0ed681f-a645-4998-bbf7-f091ddd9aad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:30:51.254135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:51.366295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed681f-a645-4998-bbf7-f091ddd9aad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:30:51.368217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed681f-a645-4998-bbf7-f091ddd9aad7 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:30:51.387199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 750/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:31:00.774725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:31:01.384970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=50 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:10.172324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:10.172910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:10.172910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:10.247372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:32:10.248573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:10.344572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 744/1494] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:32:10.353251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f910-dba5-4c1c-b026-d6f318e661d2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:10.353732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f910-dba5-4c1c-b026-d6f318e661d2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:10.353858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f910-dba5-4c1c-b026-d6f318e661d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:10.428748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0dd8f910-dba5-4c1c-b026-d6f318e661d2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:32:10.429892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0dd8f910-dba5-4c1c-b026-d6f318e661d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:10.525449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 751/1495] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:32:10.530249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:10.531495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:10.543661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4c8fa-84dc-4864-a960-fe940c761fbb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:10.604017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:10.636784 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:10.637382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:10.637657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:10.637925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:10.638590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:32:10.638888 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:10.639886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:10.639886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:32:10.639886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:32:10.640769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:10.652200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 745/1496] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:32:10.661043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8f910-dba5-4c1c-b026-d6f318e661d2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:10.670112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8f910-dba5-4c1c-b026-d6f318e661d2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:10.730485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:10.764593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:10.765198 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:10.765473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:10.765741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:10.766381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:10.768708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:10.768708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: warnings.warn(msg) Sep 25 04:32:10.768708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: Sep 25 04:32:10.769894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:10.826276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 752/1497] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:32:10 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:32:10.831019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:10.832528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:10.864951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2810b7a-e773-431d-8f76-533fa8fc56e6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:10.956495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:10.957137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:10.957415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:10.957683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:10.958314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:10.959343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:10.959343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:32:10.959343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:32:10.960552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:11.001525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 746/1498] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:32:10 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:32:11.006084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:11.007672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:11.069263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f96d-42c5-4772-a9e4-af4947bfae9a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:11.150072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:11.160934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:11.161538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:11.161813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:11.162088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:11.162778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:11.163780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:11.163780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: warnings.warn(msg) Sep 25 04:32:11.163780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: Sep 25 04:32:11.164658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:11.177122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 753/1499] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:32:11.181275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:11.182838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:11.195074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e7d7-a595-4193-ac71-ae121915d5e7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:11.219561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:11.290204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955c303-45e0-4819-b0d4-0cfc8b8e8ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:11.290836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c303-45e0-4819-b0d4-0cfc8b8e8ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:11.291127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c303-45e0-4819-b0d4-0cfc8b8e8ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:11.291381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c303-45e0-4819-b0d4-0cfc8b8e8ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:11.292018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955c303-45e0-4819-b0d4-0cfc8b8e8ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:11.293021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-e955c303-45e0-4819-b0d4-0cfc8b8e8ee5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:11.293021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:32:11.293021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:32:11.293919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955c303-45e0-4819-b0d4-0cfc8b8e8ee5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:11.305886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 747/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:32:11.310039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:11.311616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:11.345327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bf4fc-2bd1-4dcc-b53e-709eacf5535e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:11.437765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13e5b-7987-4f20-8407-5c1ef674647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:11.438448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13e5b-7987-4f20-8407-5c1ef674647b admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:11.438730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13e5b-7987-4f20-8407-5c1ef674647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:11.439003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13e5b-7987-4f20-8407-5c1ef674647b admin admin] PATH_INFO: `/v3/projects/5df2cbf619764fc59267b0be2ab6a06c/users/e2dcca228d8044a791e4c075c3cdd42d/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:11.465360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af13e5b-7987-4f20-8407-5c1ef674647b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df2cbf619764fc59267b0be2ab6a06c, user_id=e2dcca228d8044a791e4c075c3cdd42d, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:11.466437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-2af13e5b-7987-4f20-8407-5c1ef674647b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:11.466437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: warnings.warn(msg) Sep 25 04:32:11.466437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: Sep 25 04:32:11.468412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af13e5b-7987-4f20-8407-5c1ef674647b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:11.491933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 754/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:32:11 2022] PUT /identity/v3/projects/5df2cbf619764fc59267b0be2ab6a06c/users/e2dcca228d8044a791e4c075c3cdd42d/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:32:11.504530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985ebde-b915-4e43-ad1b-61b407a43aea None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:11.504816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985ebde-b915-4e43-ad1b-61b407a43aea None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:11.505089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985ebde-b915-4e43-ad1b-61b407a43aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:11.561585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2985ebde-b915-4e43-ad1b-61b407a43aea None None] MFA Rules not processed for user `e2dcca228d8044a791e4c075c3cdd42d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:32:11.562783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2985ebde-b915-4e43-ad1b-61b407a43aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:11.756504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 748/1502] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:32:11.770252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3981-a318-466c-929d-0334af4be17c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:11.770570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3981-a318-466c-929d-0334af4be17c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:11.770845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3981-a318-466c-929d-0334af4be17c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:11.772201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 755/1503] 10.222.0.52 () {54 vars in 963 bytes} [Sun Sep 25 04:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:32:11.777100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb287a-e2ec-459f-bea0-8e5948b38ed4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:11.777384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb287a-e2ec-459f-bea0-8e5948b38ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:11.777658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb287a-e2ec-459f-bea0-8e5948b38ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:11.808758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:11.852226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-84eb287a-e2ec-459f-bea0-8e5948b38ed4 None None] MFA Rules not processed for user `f955275faf8349fc8d42068bd774ad10`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:32:11.853370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-84eb287a-e2ec-459f-bea0-8e5948b38ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:11.927516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 749/1504] 10.222.0.52 () {58 vars in 1060 bytes} [Sun Sep 25 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:32:11.935244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3981-a318-466c-929d-0334af4be17c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:11.936789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fb1e3981-a318-466c-929d-0334af4be17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:11.986902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:12.040733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3981-a318-466c-929d-0334af4be17c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:12.116250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:12.116776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:12.117056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:12.117326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:12.118955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:12.216660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:12.218091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:12.221565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:12.236713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 756/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:32:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:32:12.282320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb349-7484-4231-b90d-497e9cc8617a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:12.282781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb349-7484-4231-b90d-497e9cc8617a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:12.282886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb349-7484-4231-b90d-497e9cc8617a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:12.284675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 750/1506] 10.222.0.52 () {52 vars in 830 bytes} [Sun Sep 25 04:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:32:12.288332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:12.289566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:12.387857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e19f-4072-4bba-b88a-c463ce7eb905 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:12.479907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:12.480536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:12.480815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:12.481087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] PATH_INFO: `/v3/users/e2dcca228d8044a791e4c075c3cdd42d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:12.494118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dcca228d8044a791e4c075c3cdd42d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:12.495178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:12.495178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: warnings.warn(msg) Sep 25 04:32:12.495178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: Sep 25 04:32:12.496418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:12.505808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:12.562335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dcca228d8044a791e4c075c3cdd42d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:12.571526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dcca228d8044a791e4c075c3cdd42d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:12.572110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dcca228d8044a791e4c075c3cdd42d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:12.572566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dcca228d8044a791e4c075c3cdd42d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:12.588187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dcca228d8044a791e4c075c3cdd42d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:12.617343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 757/1507] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:32:12 2022] DELETE /identity/v3/users/e2dcca228d8044a791e4c075c3cdd42d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:32:12.621912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:12.622197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:12.622510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:12.678581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:32:12.679736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:12.753825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:12.766764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 751/1508] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:32:12.779331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:12.780569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:12.881222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d396a-1370-44cd-813b-1760c30170a6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:12.935619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:12.955970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b288f-2e73-4f09-82f6-d12a36215138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:12.956632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b288f-2e73-4f09-82f6-d12a36215138 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:12.956940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b288f-2e73-4f09-82f6-d12a36215138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:12.957220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b288f-2e73-4f09-82f6-d12a36215138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:12.958916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-365b288f-2e73-4f09-82f6-d12a36215138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:13.066146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b288f-2e73-4f09-82f6-d12a36215138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:13.067882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b288f-2e73-4f09-82f6-d12a36215138 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:13.086086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 758/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:32:13.443651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:32:13.444955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:32:13.461945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826f5e-583f-4c52-873f-35ce18107132 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:32:13.561057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:32:13.561697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:32:13.561976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:32:13.562250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] PATH_INFO: `/v3/projects/5df2cbf619764fc59267b0be2ab6a06c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:32:13.574395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df2cbf619764fc59267b0be2ab6a06c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:32:13.575426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:32:13.575426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:32:13.575426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:32:13.576628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:32:13.641601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df2cbf619764fc59267b0be2ab6a06c', 'request_id': 'req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:13.656304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df2cbf619764fc59267b0be2ab6a06c', 'request_id': 'req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:13.667923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df2cbf619764fc59267b0be2ab6a06c', 'request_id': 'req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:13.691667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] The token cache is being invalidate because project 5df2cbf619764fc59267b0be2ab6a06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:32:13.692229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:13.692759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58f3dd71-d0e9-4705-82d5-2a1a1bc0bef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:32:13.694143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 752/1510] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:32:13 2022] DELETE /identity/v3/projects/5df2cbf619764fc59267b0be2ab6a06c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:32:23.083875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=62 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:32:23.689289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:33:42.671744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e190e-748a-4ddf-acd2-1db769167253 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:42.672330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e190e-748a-4ddf-acd2-1db769167253 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:42.672330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e190e-748a-4ddf-acd2-1db769167253 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:42.673640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:33:42.678997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ebf8a-f7bb-422e-aa00-c93e1a5e84b8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:42.679429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ebf8a-f7bb-422e-aa00-c93e1a5e84b8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:42.679558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ebf8a-f7bb-422e-aa00-c93e1a5e84b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:42.758696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-799ebf8a-f7bb-422e-aa00-c93e1a5e84b8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:33:42.759989 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-799ebf8a-f7bb-422e-aa00-c93e1a5e84b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:33:42.862199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:33:43.012847 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e190e-748a-4ddf-acd2-1db769167253 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:33:43.015009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b48e190e-748a-4ddf-acd2-1db769167253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:33:43.138108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e190e-748a-4ddf-acd2-1db769167253 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:33:43.144487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39fe74-13b1-4f9f-9d90-a996a57f21af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:33:43.145101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fe74-13b1-4f9f-9d90-a996a57f21af service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:43.145386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fe74-13b1-4f9f-9d90-a996a57f21af service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:43.145665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fe74-13b1-4f9f-9d90-a996a57f21af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:43.153868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39fe74-13b1-4f9f-9d90-a996a57f21af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:33:43.155507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39fe74-13b1-4f9f-9d90-a996a57f21af service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:33:43.166009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 760/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:33:44.252861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f49cb-b5e8-43b4-a500-c2446f57ddee None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:44.253378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f49cb-b5e8-43b4-a500-c2446f57ddee None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:44.253486 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f49cb-b5e8-43b4-a500-c2446f57ddee None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:44.254817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:33:44.263769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbee88-9e3d-4587-86c2-1618b94dfe62 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:44.264231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbee88-9e3d-4587-86c2-1618b94dfe62 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:44.264337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbee88-9e3d-4587-86c2-1618b94dfe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:44.287134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fbbbee88-9e3d-4587-86c2-1618b94dfe62 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:33:44.288357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fbbbee88-9e3d-4587-86c2-1618b94dfe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:33:44.296221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:33:44.352520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b096ff-a4b3-4579-945b-83719c6f5fc8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:44.352802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b096ff-a4b3-4579-945b-83719c6f5fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:44.353074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b096ff-a4b3-4579-945b-83719c6f5fc8 None None] PATH_INFO: `/v3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:44.354373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 755/1516] 10.222.0.49 () {54 vars in 925 bytes} [Sun Sep 25 04:33:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:33:44.360739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c27cb-bdb0-4348-9a62-a758e7d6d1fc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:44.361027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c27cb-bdb0-4348-9a62-a758e7d6d1fc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:44.361304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c27cb-bdb0-4348-9a62-a758e7d6d1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:44.419742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1d2c27cb-bdb0-4348-9a62-a758e7d6d1fc None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:33:44.420935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1d2c27cb-bdb0-4348-9a62-a758e7d6d1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:33:44.449797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b096ff-a4b3-4579-945b-83719c6f5fc8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:33:44.465081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b096ff-a4b3-4579-945b-83719c6f5fc8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:33:44.470448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a7a47-c1f8-4262-8af2-d66384fa2cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:33:44.471043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7a47-c1f8-4262-8af2-d66384fa2cde service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:44.471320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7a47-c1f8-4262-8af2-d66384fa2cde service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:44.471590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7a47-c1f8-4262-8af2-d66384fa2cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:44.477205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:33:44.480178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a7a47-c1f8-4262-8af2-d66384fa2cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:33:44.481773 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a7a47-c1f8-4262-8af2-d66384fa2cde service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:33:44.491296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 756/1517] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:33:44.496743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 762/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 25 04:33:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:33:48.044228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1fea0-91ce-47bb-acde-80c1d7406bdc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:48.044747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1fea0-91ce-47bb-acde-80c1d7406bdc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:48.044747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1fea0-91ce-47bb-acde-80c1d7406bdc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:48.046096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 757/1519] 10.222.0.52 () {54 vars in 961 bytes} [Sun Sep 25 04:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:33:48.051672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e8f-7812-410a-ad05-dce918219a58 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:48.052097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e8f-7812-410a-ad05-dce918219a58 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:48.052213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e8f-7812-410a-ad05-dce918219a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:48.072160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-de738e8f-7812-410a-ad05-dce918219a58 None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:33:48.073383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-de738e8f-7812-410a-ad05-dce918219a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:33:48.083654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 763/1520] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Sep 25 04:33:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:33:48.093241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1fea0-91ce-47bb-acde-80c1d7406bdc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:33:48.108433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1fea0-91ce-47bb-acde-80c1d7406bdc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:33:48.113930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2de26b-b9a3-45c1-8203-e0b0846c08b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:33:48.114563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de26b-b9a3-45c1-8203-e0b0846c08b8 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:48.114841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de26b-b9a3-45c1-8203-e0b0846c08b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:48.115111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de26b-b9a3-45c1-8203-e0b0846c08b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:48.123591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2de26b-b9a3-45c1-8203-e0b0846c08b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:33:48.125149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2de26b-b9a3-45c1-8203-e0b0846c08b8 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:33:48.134813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 758/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:33:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:33:55.969642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88defb-9923-4bfb-bdfa-0e0fac0d02fc None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:55.970285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88defb-9923-4bfb-bdfa-0e0fac0d02fc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:55.970285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88defb-9923-4bfb-bdfa-0e0fac0d02fc None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:55.971560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:33:55.977651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9827-e6ae-4feb-b8a1-d0eb69a73eb0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:55.978064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9827-e6ae-4feb-b8a1-d0eb69a73eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:55.978217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9827-e6ae-4feb-b8a1-d0eb69a73eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:55.998320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5a2e9827-e6ae-4feb-b8a1-d0eb69a73eb0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:33:55.999540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a2e9827-e6ae-4feb-b8a1-d0eb69a73eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:33:56.008150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:33:56.163414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88defb-9923-4bfb-bdfa-0e0fac0d02fc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:33:56.178445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88defb-9923-4bfb-bdfa-0e0fac0d02fc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:33:56.183880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911f031-3153-4f81-965c-fecef3813dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:33:56.184512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f031-3153-4f81-965c-fecef3813dca service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:56.184790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f031-3153-4f81-965c-fecef3813dca service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:56.185062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f031-3153-4f81-965c-fecef3813dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:56.194007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911f031-3153-4f81-965c-fecef3813dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:33:56.195892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911f031-3153-4f81-965c-fecef3813dca service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:33:56.205152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 765/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:33:57.272430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e8fc-8585-40d5-9399-85c42c331309 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:57.272910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e8fc-8585-40d5-9399-85c42c331309 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:57.273008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e8fc-8585-40d5-9399-85c42c331309 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:57.274304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 04:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:33:57.280464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc50a6-5fc9-4cb9-98d0-409bb97e090d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:57.280885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc50a6-5fc9-4cb9-98d0-409bb97e090d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:57.281016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc50a6-5fc9-4cb9-98d0-409bb97e090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:57.301364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-02dc50a6-5fc9-4cb9-98d0-409bb97e090d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:33:57.302606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-02dc50a6-5fc9-4cb9-98d0-409bb97e090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:33:57.310467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:33:57.459177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e8fc-8585-40d5-9399-85c42c331309 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:33:57.474235 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e8fc-8585-40d5-9399-85c42c331309 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:33:57.479668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f30a-8d0d-4380-8ed2-bcc497e919ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:33:57.480264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f30a-8d0d-4380-8ed2-bcc497e919ba service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:33:57.480553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f30a-8d0d-4380-8ed2-bcc497e919ba service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:33:57.480831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f30a-8d0d-4380-8ed2-bcc497e919ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:33:57.489478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555f30a-8d0d-4380-8ed2-bcc497e919ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:33:57.491102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555f30a-8d0d-4380-8ed2-bcc497e919ba service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:33:57.500446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 761/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:34:01.814445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cecb1-7b43-4461-8c0a-966ff3d4f8aa None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:01.815005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cecb1-7b43-4461-8c0a-966ff3d4f8aa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:01.815005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cecb1-7b43-4461-8c0a-966ff3d4f8aa None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:01.816852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:34:01.822448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2434214-d1d0-4102-9509-48a9e8dac74b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:01.822861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2434214-d1d0-4102-9509-48a9e8dac74b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:01.823007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2434214-d1d0-4102-9509-48a9e8dac74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:01.844228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a2434214-d1d0-4102-9509-48a9e8dac74b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:34:01.845439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a2434214-d1d0-4102-9509-48a9e8dac74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:34:01.853291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:34:02.149087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cecb1-7b43-4461-8c0a-966ff3d4f8aa None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:34:02.150815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b35cecb1-7b43-4461-8c0a-966ff3d4f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:34:02.226918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cecb1-7b43-4461-8c0a-966ff3d4f8aa None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:34:02.230438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5b074-f31c-4e34-a7b7-ea189f2dfdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:34:02.231032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b074-f31c-4e34-a7b7-ea189f2dfdee service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:02.231309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b074-f31c-4e34-a7b7-ea189f2dfdee service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:02.231583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b074-f31c-4e34-a7b7-ea189f2dfdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:02.240712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5b074-f31c-4e34-a7b7-ea189f2dfdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:34:02.242121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5b074-f31c-4e34-a7b7-ea189f2dfdee service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:34:02.251223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 768/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:34:04.410041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee31fe8-3628-4cb8-a4d6-a0f6c17a7b28 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:04.410611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee31fe8-3628-4cb8-a4d6-a0f6c17a7b28 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:04.410611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee31fe8-3628-4cb8-a4d6-a0f6c17a7b28 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:04.411968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:34:04.417189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f58057-cf5b-4024-a29d-c51aacb69ec9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:04.417582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f58057-cf5b-4024-a29d-c51aacb69ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:04.417760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f58057-cf5b-4024-a29d-c51aacb69ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:04.437447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-48f58057-cf5b-4024-a29d-c51aacb69ec9 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:34:04.438688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-48f58057-cf5b-4024-a29d-c51aacb69ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:34:04.447298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:34:04.735259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee31fe8-3628-4cb8-a4d6-a0f6c17a7b28 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:34:04.741145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:34:04.747472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee31fe8-3628-4cb8-a4d6-a0f6c17a7b28 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:34:04.751017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b56d8-a362-4cb7-b197-3558e298dadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:34:04.751638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b56d8-a362-4cb7-b197-3558e298dadf service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:04.751917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b56d8-a362-4cb7-b197-3558e298dadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:04.752185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b56d8-a362-4cb7-b197-3558e298dadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:04.761169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b56d8-a362-4cb7-b197-3558e298dadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:34:04.762632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b56d8-a362-4cb7-b197-3558e298dadf service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:34:04.771958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 764/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:34:08.531741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496771f-4209-4a99-879b-330bf82b465c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:08.532288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496771f-4209-4a99-879b-330bf82b465c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:08.532288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496771f-4209-4a99-879b-330bf82b465c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:08.533535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:34:08.539497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee91cf-927e-4a32-82aa-69b62fc67422 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:08.539951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee91cf-927e-4a32-82aa-69b62fc67422 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:08.540056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee91cf-927e-4a32-82aa-69b62fc67422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:08.559706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a0ee91cf-927e-4a32-82aa-69b62fc67422 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:34:08.560908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a0ee91cf-927e-4a32-82aa-69b62fc67422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:34:08.568999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:34:08.869577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496771f-4209-4a99-879b-330bf82b465c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:34:08.871292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b496771f-4209-4a99-879b-330bf82b465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:34:08.949262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496771f-4209-4a99-879b-330bf82b465c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:34:08.952848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca00b6c-c91f-4971-8748-f19719a6097f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:34:08.953448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00b6c-c91f-4971-8748-f19719a6097f service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:08.953729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00b6c-c91f-4971-8748-f19719a6097f service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:08.954007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00b6c-c91f-4971-8748-f19719a6097f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:08.963578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca00b6c-c91f-4971-8748-f19719a6097f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:34:08.965400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca00b6c-c91f-4971-8748-f19719a6097f service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:34:08.975532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 771/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:34:11.102872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b62e4d-c1f3-41b2-8e2c-c8fe41483ed2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:11.103401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b62e4d-c1f3-41b2-8e2c-c8fe41483ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:11.103401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b62e4d-c1f3-41b2-8e2c-c8fe41483ed2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:11.104670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 04:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:34:11.110171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebeacb-49c9-41df-993b-205c856aee92 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:11.110589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebeacb-49c9-41df-993b-205c856aee92 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:11.110781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebeacb-49c9-41df-993b-205c856aee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:11.129959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bfebeacb-49c9-41df-993b-205c856aee92 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:34:11.131178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bfebeacb-49c9-41df-993b-205c856aee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:34:11.138895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 04:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:34:11.459312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b62e4d-c1f3-41b2-8e2c-c8fe41483ed2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:34:11.461029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82b62e4d-c1f3-41b2-8e2c-c8fe41483ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:34:11.474484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b62e4d-c1f3-41b2-8e2c-c8fe41483ed2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:34:11.478018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e39e5-4b30-45f2-9caa-622ee3be7f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:34:11.478645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e39e5-4b30-45f2-9caa-622ee3be7f2b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:34:11.478930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e39e5-4b30-45f2-9caa-622ee3be7f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:34:11.479205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e39e5-4b30-45f2-9caa-622ee3be7f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:34:11.488574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e39e5-4b30-45f2-9caa-622ee3be7f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:34:11.490007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e39e5-4b30-45f2-9caa-622ee3be7f2b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:34:11.499874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 767/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:34:21.125080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:34:21.495387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=14 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:38.137609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685699bc-0d08-47d7-aac5-b3121ec99733 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.138627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685699bc-0d08-47d7-aac5-b3121ec99733 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.138627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685699bc-0d08-47d7-aac5-b3121ec99733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.165614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-685699bc-0d08-47d7-aac5-b3121ec99733 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.166874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-685699bc-0d08-47d7-aac5-b3121ec99733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.181972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 773/1540] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.189663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0afc76-b2fb-4599-8611-1711b03409e2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.190968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0afc76-b2fb-4599-8611-1711b03409e2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.194774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0afc76-b2fb-4599-8611-1711b03409e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.227615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2d0afc76-b2fb-4599-8611-1711b03409e2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.229460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d0afc76-b2fb-4599-8611-1711b03409e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.240565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 768/1541] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.245415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685699bc-0d08-47d7-aac5-b3121ec99733 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.262838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc129eb4-d3ed-4aa8-b2d7-55a041ceea50 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.263423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc129eb4-d3ed-4aa8-b2d7-55a041ceea50 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.263962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc129eb4-d3ed-4aa8-b2d7-55a041ceea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.275841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685699bc-0d08-47d7-aac5-b3121ec99733 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.285412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.285679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.285775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.290570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.290570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:38.290570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.290570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:35:38.290570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: warnings.warn(msg) Sep 25 04:35:38.290570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: Sep 25 04:35:38.290570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac88d-a679-403d-afad-8d35826fb6bc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.303997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dc129eb4-d3ed-4aa8-b2d7-55a041ceea50 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.305727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dc129eb4-d3ed-4aa8-b2d7-55a041ceea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.323064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 774/1542] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:38.324522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5626f-0cfa-4ec1-ba86-a102ac78b761 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.324814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5626f-0cfa-4ec1-ba86-a102ac78b761 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.325096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5626f-0cfa-4ec1-ba86-a102ac78b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.328040 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 769/1543] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.331189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc129eb4-d3ed-4aa8-b2d7-55a041ceea50 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.344002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc129eb4-d3ed-4aa8-b2d7-55a041ceea50 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.360515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-23e5626f-0cfa-4ec1-ba86-a102ac78b761 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.361587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e51e-b155-4b2d-8285-0fb7cfc7282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.361743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-23e5626f-0cfa-4ec1-ba86-a102ac78b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.362624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e51e-b155-4b2d-8285-0fb7cfc7282f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.363217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e51e-b155-4b2d-8285-0fb7cfc7282f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.363714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e51e-b155-4b2d-8285-0fb7cfc7282f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.364819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e51e-b155-4b2d-8285-0fb7cfc7282f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.366160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-9640e51e-b155-4b2d-8285-0fb7cfc7282f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:35:38.366160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:35:38.366160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:35:38.367818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e51e-b155-4b2d-8285-0fb7cfc7282f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.390783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 775/1544] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.390783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac029b-6ed2-4864-ae6e-6efbb4a47db8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.390783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac029b-6ed2-4864-ae6e-6efbb4a47db8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.390783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac029b-6ed2-4864-ae6e-6efbb4a47db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.421611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 770/1545] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:35:38.422974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2c9d-a501-493e-99ae-535957ccbf9d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.423298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2c9d-a501-493e-99ae-535957ccbf9d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.423576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2c9d-a501-493e-99ae-535957ccbf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.426477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dcac029b-6ed2-4864-ae6e-6efbb4a47db8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.427707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dcac029b-6ed2-4864-ae6e-6efbb4a47db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.444661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-885d2c9d-a501-493e-99ae-535957ccbf9d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.446135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-885d2c9d-a501-493e-99ae-535957ccbf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.499122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 776/1546] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.500846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc30e66-9cca-42ad-ad4b-1c45918a338a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.501143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc30e66-9cca-42ad-ad4b-1c45918a338a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.501422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc30e66-9cca-42ad-ad4b-1c45918a338a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.513207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 771/1547] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.521289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3539f57-77cd-4c7b-92e0-dced0d42e72c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.521632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3539f57-77cd-4c7b-92e0-dced0d42e72c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.521913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3539f57-77cd-4c7b-92e0-dced0d42e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.524065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ebc30e66-9cca-42ad-ad4b-1c45918a338a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.525297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ebc30e66-9cca-42ad-ad4b-1c45918a338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.534574 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 777/1548] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.536592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b639b82-9dd6-416f-9f0a-8ef6b1af5ae5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.536943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b639b82-9dd6-416f-9f0a-8ef6b1af5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.537226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b639b82-9dd6-416f-9f0a-8ef6b1af5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.547076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e3539f57-77cd-4c7b-92e0-dced0d42e72c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.548299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e3539f57-77cd-4c7b-92e0-dced0d42e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.558340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5b639b82-9dd6-416f-9f0a-8ef6b1af5ae5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.559557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5b639b82-9dd6-416f-9f0a-8ef6b1af5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.560925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 772/1549] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.561821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3539f57-77cd-4c7b-92e0-dced0d42e72c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.568829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 778/1550] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.569930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b639b82-9dd6-416f-9f0a-8ef6b1af5ae5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.571744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3539f57-77cd-4c7b-92e0-dced0d42e72c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.576560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598d4d-5095-4d67-be68-6e4c37a734fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.577155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598d4d-5095-4d67-be68-6e4c37a734fa admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.577432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598d4d-5095-4d67-be68-6e4c37a734fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.577704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598d4d-5095-4d67-be68-6e4c37a734fa admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.578330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e598d4d-5095-4d67-be68-6e4c37a734fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.579790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b639b82-9dd6-416f-9f0a-8ef6b1af5ae5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.580264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e598d4d-5095-4d67-be68-6e4c37a734fa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.584434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c46f2-46fc-4f2d-8613-1d8c19a598a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.585022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c46f2-46fc-4f2d-8613-1d8c19a598a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.585302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c46f2-46fc-4f2d-8613-1d8c19a598a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.585576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c46f2-46fc-4f2d-8613-1d8c19a598a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.586213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c46f2-46fc-4f2d-8613-1d8c19a598a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:38.586547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c46f2-46fc-4f2d-8613-1d8c19a598a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.588138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c46f2-46fc-4f2d-8613-1d8c19a598a4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.601065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 779/1551] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:38.604979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 773/1552] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:38.605142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f97b-9080-417b-a2b7-c996438d9fe9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.605142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f97b-9080-417b-a2b7-c996438d9fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.605142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f97b-9080-417b-a2b7-c996438d9fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.605414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7686-11c1-43a1-91dd-be4b8d3ae313 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.605414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7686-11c1-43a1-91dd-be4b8d3ae313 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.605414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7686-11c1-43a1-91dd-be4b8d3ae313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.624815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4416f97b-9080-417b-a2b7-c996438d9fe9 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.625068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f2c7686-11c1-43a1-91dd-be4b8d3ae313 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.626045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4416f97b-9080-417b-a2b7-c996438d9fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.626265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f2c7686-11c1-43a1-91dd-be4b8d3ae313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.633996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 780/1553] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.634430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 774/1554] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.635448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4df4-b2a1-4324-91d3-b390ae8b6f17 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.635625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8545ac-159e-4e39-9fd6-e4d948d5a8df None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.635740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4df4-b2a1-4324-91d3-b390ae8b6f17 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.635900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8545ac-159e-4e39-9fd6-e4d948d5a8df None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.636005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4df4-b2a1-4324-91d3-b390ae8b6f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.636174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8545ac-159e-4e39-9fd6-e4d948d5a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.655833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ac8545ac-159e-4e39-9fd6-e4d948d5a8df None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.656639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-779f4df4-b2a1-4324-91d3-b390ae8b6f17 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.656965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac8545ac-159e-4e39-9fd6-e4d948d5a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.657824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-779f4df4-b2a1-4324-91d3-b390ae8b6f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.665123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 775/1555] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.665734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8545ac-159e-4e39-9fd6-e4d948d5a8df None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.670887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 781/1556] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.672049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47916b5f-a6c1-4056-8b7c-10c4e4788bfa None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.672340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47916b5f-a6c1-4056-8b7c-10c4e4788bfa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.672616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47916b5f-a6c1-4056-8b7c-10c4e4788bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.676607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8545ac-159e-4e39-9fd6-e4d948d5a8df None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.681308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.681902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.682187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.682485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.683139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:38.683441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.685064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.694609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-47916b5f-a6c1-4056-8b7c-10c4e4788bfa None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.696142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-47916b5f-a6c1-4056-8b7c-10c4e4788bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.697487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 776/1557] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:38.698295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.704811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 782/1558] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.706057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47916b5f-a6c1-4056-8b7c-10c4e4788bfa None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.711628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c21da-d23a-4e05-95e0-fb2a62368cb9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.716664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231d0b9-99e5-430f-97ce-8869727ff55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.717273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d0b9-99e5-430f-97ce-8869727ff55b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.717387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47916b5f-a6c1-4056-8b7c-10c4e4788bfa None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.717562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d0b9-99e5-430f-97ce-8869727ff55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.717838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d0b9-99e5-430f-97ce-8869727ff55b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.718497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231d0b9-99e5-430f-97ce-8869727ff55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.720404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231d0b9-99e5-430f-97ce-8869727ff55b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.721953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.723158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.723448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.723717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.724361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.725956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.736410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 783/1559] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:38.737300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.748211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf59da-692b-4e85-a2ba-504192c5aafb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.753853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 777/1560] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:38.753853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0ec4-7685-4db4-850f-ceb41655feee None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.753853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0ec4-7685-4db4-850f-ceb41655feee None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.753853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0ec4-7685-4db4-850f-ceb41655feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.756528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.757133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.757417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.757721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.758453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:38.758763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.760391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.773030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ad0d0ec4-7685-4db4-850f-ceb41655feee None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.773222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 784/1561] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:38.773914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.774300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad0d0ec4-7685-4db4-850f-ceb41655feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.783767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52593ff6-1a8c-4827-9573-f67cd101571b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.819779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:38.841576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.842070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 778/1562] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.845777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.845777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.845777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.845777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:38.846117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83e74-90de-49dd-9d86-ba8822217915 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.846203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.846286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83e74-90de-49dd-9d86-ba8822217915 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.846286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83e74-90de-49dd-9d86-ba8822217915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.846467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.852951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:38.866142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 785/1563] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:38.866142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.866403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eef83e74-90de-49dd-9d86-ba8822217915 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:38.866403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eef83e74-90de-49dd-9d86-ba8822217915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:38.870197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc30c1-3d00-41ac-93b8-768dbc587a04 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.873933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 779/1564] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:38.874813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83e74-90de-49dd-9d86-ba8822217915 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.875047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.875747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.876035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.876311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.876945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.879000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.884327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83e74-90de-49dd-9d86-ba8822217915 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.888932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.891254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.891545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.891827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.892479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:38.892816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.895009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.907398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 786/1565] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:38.907560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 780/1566] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:38.907981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.915218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:38.917898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09f22b-ca08-4f28-89bd-da9ceb284b78 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.976481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.977132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.977418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.977698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.977994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff6efc-6d86-487b-8f3c-3d813337e549 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:38.978333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.980329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.982558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:38.983165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:38.983441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:38.983713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:38.984349 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:38.985921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:38.997420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 787/1567] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:38.998210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.005224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 781/1568] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.006052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.013491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a3a69-6cbf-49bd-9a17-499db1993180 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.015423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d656-8895-4620-871c-f0a8fb705f85 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.018317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.018997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.019280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.019556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.019974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.020190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.020549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.020827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.021099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.021746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:39.022037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.022154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.023746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.036389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 782/1569] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:39.043871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.046574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52992-2ef6-48ab-aa08-67b2af7a9a92 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.051559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.052125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.052405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.052674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.053289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.055276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.062703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 788/1570] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:38 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.062703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.088389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 783/1571] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.089286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.126369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da2150-a014-4b8a-afa4-f20cba8f4474 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.151421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21de9dd-af62-43af-9a3d-76c1fe09f914 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.156054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.156662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.156938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.157210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.157903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.160328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.178907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:39.182024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 784/1572] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.182885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.185872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.186914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.187207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.187509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.188130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:39.188613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.190594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.196047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c553-5cd7-42a5-8568-d0456d2d2213 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.200754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.201343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.201623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.202018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.202710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.203099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 789/1573] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:39.204621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.208511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.210335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:39.220049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511190d0-7a48-45bf-bbe9-9918a5d0d41f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.225795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.226583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.227055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.227519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] PATH_INFO: `/v3/projects/409732498552405fb683310ed8fa5743/users/fb302e19a6e64565a706431947214bc2/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.236069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 785/1574] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.236900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.249524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=409732498552405fb683310ed8fa5743, user_id=fb302e19a6e64565a706431947214bc2, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.252424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.267622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 790/1575] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:39 2022] PUT /identity/v3/projects/409732498552405fb683310ed8fa5743/users/fb302e19a6e64565a706431947214bc2/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:39.268542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.307105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc39f7-d70b-47db-9786-2ef105fd74eb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.338503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9878b4-3192-4dfe-b63e-149c46b5d771 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.343262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.343871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.344152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.344432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.345074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.347065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.367529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.368356 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.368662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.368928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.369643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.371329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.374803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 791/1576] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.375610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.385256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 786/1577] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.385256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.393096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4ba99-3685-431b-b937-f28e2369a120 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.441564 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb271f-219c-49ee-837f-b827b3022395 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.446682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.447331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.447613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.447895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.448535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.449556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:35:39.449556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: warnings.warn(msg) Sep 25 04:35:39.449556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: Sep 25 04:35:39.450815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.453652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.454335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.454641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.454917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.455543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.457624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.477786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 792/1578] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.477786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.480538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 787/1579] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.481498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.486170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04958718-3b91-473a-a8b4-8e1880f2641b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.491726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.492323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.492438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3b6-5de9-4a15-90b5-689c65b332f6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.492602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.492878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.493515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.495313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.497124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651cf75-0aa4-40ed-9017-42b215e5ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.497857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651cf75-0aa4-40ed-9017-42b215e5ee6e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.498139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651cf75-0aa4-40ed-9017-42b215e5ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.498452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651cf75-0aa4-40ed-9017-42b215e5ee6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.499085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651cf75-0aa4-40ed-9017-42b215e5ee6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.501029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651cf75-0aa4-40ed-9017-42b215e5ee6e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.507349 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 793/1580] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.507349 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.517504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bef409-1d38-4fb4-9104-5808e76fc66e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.523423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:39.524045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.524667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.524944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.525384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.526113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.528193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.531827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 788/1581] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.533172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51f05-bbb5-4f6a-96ee-99ee80d7b1bb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.533464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51f05-bbb5-4f6a-96ee-99ee80d7b1bb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.533740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51f05-bbb5-4f6a-96ee-99ee80d7b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.553760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 794/1582] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.553760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.561151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20736-a25c-49ee-a40b-6fac359f93b0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.564714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b2a51f05-bbb5-4f6a-96ee-99ee80d7b1bb None None] MFA Rules not processed for user `fb302e19a6e64565a706431947214bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:39.565942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2a51f05-bbb5-4f6a-96ee-99ee80d7b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:39.570135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:39.620192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.620808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.621091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.621368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.622003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.624217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.631645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 789/1583] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:39.632898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51f05-bbb5-4f6a-96ee-99ee80d7b1bb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.645827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51f05-bbb5-4f6a-96ee-99ee80d7b1bb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.646442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 795/1584] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.647351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.654401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.655024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.655302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.655574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.656253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.657411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddbaf3-1b21-400d-906a-499d4965e72e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.657893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.662168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.662799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.663081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.663355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.663987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.665709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.668207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 790/1585] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.669039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.680976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 796/1586] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.680976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.681261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb00d6-bd1c-45e1-872b-7794293ea94d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.684024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.684623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.684903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.685189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.685824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.687478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.688768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c3678-68d2-4c5d-9810-f432e306b0d6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.694055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.694618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.694908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.695180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.696073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.697647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.698437 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 791/1587] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.699238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.711431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 797/1588] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.711634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd6ff-e33b-409a-add4-3972f26230fa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.711753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.713620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.714217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.714528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.714804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.715431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.717362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.719968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698347-3873-4ced-8986-48161b184ce3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.726582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.727186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.727474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.727750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.728395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.729995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.741936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 798/1589] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.742792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.750909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 792/1590] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/users => generated 303 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.752714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844c5d2-12c4-48ef-ab32-a285ca24cd11 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.755232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.758399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.759065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.759411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.759755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.760481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.762452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.764981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2a4d-2c81-4df3-b869-31a39bc87f02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.769890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.770538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.770842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.771113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.771756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.773348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.784116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 793/1591] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.785503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.791183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 799/1592] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:39 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:39.791783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.795425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dff6f3-b0c8-44bd-9887-486e7a61aeb4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.853592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.854252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.854570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.854845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] PATH_INFO: `/v3/projects/d5a1b9fad1744e4694fde82b0b63fe5d/users/7a305b37b6fc42f2938cf55ea9b1acdc/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.857626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9408b2-3a03-4a00-b3d2-d33d958795c7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.862237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.862911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.863192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.863461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.864129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.865727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.869964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a1b9fad1744e4694fde82b0b63fe5d, user_id=7a305b37b6fc42f2938cf55ea9b1acdc, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.871498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:35:39.871498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:35:39.871498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:35:39.873663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.879999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 800/1593] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.879999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.892304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf271-6157-4652-9f43-8ace66851a09 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.893182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 794/1594] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:39 2022] PUT /identity/v3/projects/d5a1b9fad1744e4694fde82b0b63fe5d/users/7a305b37b6fc42f2938cf55ea9b1acdc/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:39.895248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.916347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:39.943411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:39.959628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.960167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.960402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bed99e-46ed-4f6c-9e81-6af2a514ea53 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.960508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.960699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.961335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.962969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.965237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.966007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.966289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.966786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] PATH_INFO: `/v3/projects/30bd905ba8034b5f8ac50d93d9eac570/users/5bdeb69b2259462b90c34aede652f5f1/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.973532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 801/1595] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:39.974441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:39.984082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfa213-0c42-4809-8ee3-55c21d254d0f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:39.985114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bd905ba8034b5f8ac50d93d9eac570, user_id=5bdeb69b2259462b90c34aede652f5f1, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.988540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:39.989319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:39.989972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:39.990248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:39.990551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:39.991181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:39.992757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.002469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 795/1596] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:39 2022] PUT /identity/v3/projects/30bd905ba8034b5f8ac50d93d9eac570/users/5bdeb69b2259462b90c34aede652f5f1/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:40.009567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.009690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 802/1597] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:40.009690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.015976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b0640-1287-4fc2-87cf-7919cda36b65 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.072026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b9101-d705-411a-9caa-53f367c739bb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.076929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.077356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.077806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.077965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.078075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.078245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.078382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.078571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.079032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.079220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.080655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.080847 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.091342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 803/1598] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:40.091508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 796/1599] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:40.095252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.095415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.105636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a6fd-387a-4a91-bc99-6eadd305953e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.106063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872e511-0506-42b0-b3a9-a3db38e5399e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.110259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa748e75-2814-4d73-8b6e-11b1bdb9bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.110890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748e75-2814-4d73-8b6e-11b1bdb9bbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.111052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.111172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748e75-2814-4d73-8b6e-11b1bdb9bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.111429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748e75-2814-4d73-8b6e-11b1bdb9bbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.111705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.111985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.112094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa748e75-2814-4d73-8b6e-11b1bdb9bbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.112340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] PATH_INFO: `/v3/projects/6a8005aa1f4348b097a8ae55f6d0396e/users/6d84e145672f4032ae8f6443278b75ab/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.114610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa748e75-2814-4d73-8b6e-11b1bdb9bbb4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.129337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8005aa1f4348b097a8ae55f6d0396e, user_id=6d84e145672f4032ae8f6443278b75ab, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.132370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.138215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 804/1600] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:40.139694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e735a-e277-45b3-81e7-6cc5dc3c2709 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.140650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e735a-e277-45b3-81e7-6cc5dc3c2709 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.140930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e735a-e277-45b3-81e7-6cc5dc3c2709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.146659 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 797/1601] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:40 2022] PUT /identity/v3/projects/6a8005aa1f4348b097a8ae55f6d0396e/users/6d84e145672f4032ae8f6443278b75ab/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:40.147514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.170553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f87e735a-e277-45b3-81e7-6cc5dc3c2709 None None] MFA Rules not processed for user `7a305b37b6fc42f2938cf55ea9b1acdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.172295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f87e735a-e277-45b3-81e7-6cc5dc3c2709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:40.218937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7309de-6c2c-493c-bec0-f3a05655479f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.224168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.224824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.225102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.225373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] PATH_INFO: `/v3/projects/04336b4838794993bdcb18437b260be5/users/71a6aff0e0134b66a77c751b3d8a9337/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.237773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 805/1602] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:40.239131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66368b-8083-44ef-ab84-ddec42bafc06 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.239427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66368b-8083-44ef-ab84-ddec42bafc06 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.239702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66368b-8083-44ef-ab84-ddec42bafc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.244396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04336b4838794993bdcb18437b260be5, user_id=71a6aff0e0134b66a77c751b3d8a9337, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.248390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.266983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8d66368b-8083-44ef-ab84-ddec42bafc06 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.268279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8d66368b-8083-44ef-ab84-ddec42bafc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:40.270450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:40.280400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 798/1603] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:40 2022] PUT /identity/v3/projects/04336b4838794993bdcb18437b260be5/users/71a6aff0e0134b66a77c751b3d8a9337/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:40.281590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.309447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:40.337437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 806/1604] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:40.338289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66368b-8083-44ef-ab84-ddec42bafc06 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.348252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1001c-c01f-4f84-8037-0d96810a4dc9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.348536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66368b-8083-44ef-ab84-ddec42bafc06 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.353191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.353370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.353794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.354027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.354165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.354341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.354484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.354641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] PATH_INFO: `/v3/projects/a29b552b1bef4407a420ab24fd3aa8e2/users/c7c2260cb6e643bcb63712c665144761/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.355033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.356641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.366755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 807/1605] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:40.367576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.373001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29b552b1bef4407a420ab24fd3aa8e2, user_id=c7c2260cb6e643bcb63712c665144761, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.375769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.377011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3819a-44c9-41bf-accd-d0150152ddbb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.382182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292752d-efb3-4381-b06a-c4d95092809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.382849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292752d-efb3-4381-b06a-c4d95092809a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.383128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292752d-efb3-4381-b06a-c4d95092809a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.383510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292752d-efb3-4381-b06a-c4d95092809a admin admin] PATH_INFO: `/v3/projects/82efbd082dcc41b68219678c691e5c70/users/f71ca39699984435ba165b5c24ee81a9/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.389741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 799/1606] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:40 2022] PUT /identity/v3/projects/a29b552b1bef4407a420ab24fd3aa8e2/users/c7c2260cb6e643bcb63712c665144761/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:40.390667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.399763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292752d-efb3-4381-b06a-c4d95092809a admin admin] RBAC: Authorizing `identity:create_grant(project_id=82efbd082dcc41b68219678c691e5c70, user_id=f71ca39699984435ba165b5c24ee81a9, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.403216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292752d-efb3-4381-b06a-c4d95092809a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.417126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 808/1607] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:40 2022] PUT /identity/v3/projects/82efbd082dcc41b68219678c691e5c70/users/f71ca39699984435ba165b5c24ee81a9/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:40.418581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cec5a-6806-4c2c-b9e3-145e3c8ef053 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.418868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cec5a-6806-4c2c-b9e3-145e3c8ef053 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.419152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cec5a-6806-4c2c-b9e3-145e3c8ef053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.447720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5b2cec5a-6806-4c2c-b9e3-145e3c8ef053 None None] MFA Rules not processed for user `6d84e145672f4032ae8f6443278b75ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.448961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5b2cec5a-6806-4c2c-b9e3-145e3c8ef053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:40.458704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcfb43-7556-4cb8-ac59-71fe65a68d33 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.514513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 809/1608] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:40.515867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368269-e1f9-428a-918b-027964424825 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.516182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368269-e1f9-428a-918b-027964424825 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.516454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368269-e1f9-428a-918b-027964424825 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.517694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 810/1609] 10.222.0.52 () {54 vars in 961 bytes} [Sun Sep 25 04:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:35:40.519445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.519887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3657c7-5e15-40fe-ae8d-2f0560dd7d7e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.520170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3657c7-5e15-40fe-ae8d-2f0560dd7d7e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.520296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.520488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.520589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3657c7-5e15-40fe-ae8d-2f0560dd7d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.520757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.521363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.522987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.534624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 800/1610] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:40.535385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.549146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4f3657c7-5e15-40fe-ae8d-2f0560dd7d7e None None] MFA Rules not processed for user `71a6aff0e0134b66a77c751b3d8a9337`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.550452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4f3657c7-5e15-40fe-ae8d-2f0560dd7d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:40.561473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:40.591348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843234d-9611-4c60-a38d-605ce17204e6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.594994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988218c-46c5-40b0-96af-8d09bbd40b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.595593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988218c-46c5-40b0-96af-8d09bbd40b8d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.595873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988218c-46c5-40b0-96af-8d09bbd40b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.596144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988218c-46c5-40b0-96af-8d09bbd40b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.605178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988218c-46c5-40b0-96af-8d09bbd40b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.606779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988218c-46c5-40b0-96af-8d09bbd40b8d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.615686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 811/1611] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:40.616497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3657c7-5e15-40fe-ae8d-2f0560dd7d7e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.616963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 801/1612] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:40.618294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faded9-f422-4e6b-8f25-f8ef38516470 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.618619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faded9-f422-4e6b-8f25-f8ef38516470 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.618899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faded9-f422-4e6b-8f25-f8ef38516470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.630428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3657c7-5e15-40fe-ae8d-2f0560dd7d7e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.635148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b2204-0554-4e53-bc6d-b196487fe04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.635791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2204-0554-4e53-bc6d-b196487fe04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.636079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2204-0554-4e53-bc6d-b196487fe04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.636353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2204-0554-4e53-bc6d-b196487fe04c admin admin] PATH_INFO: `/v3/projects/4d571615e133480ab75456ae998a7767/users/f9c8080755ab4f0f8feac6a2f0cca1c5/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.649200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-51faded9-f422-4e6b-8f25-f8ef38516470 None None] MFA Rules not processed for user `c7c2260cb6e643bcb63712c665144761`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.650214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-51faded9-f422-4e6b-8f25-f8ef38516470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:40.654936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b2204-0554-4e53-bc6d-b196487fe04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d571615e133480ab75456ae998a7767, user_id=f9c8080755ab4f0f8feac6a2f0cca1c5, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.657815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b2204-0554-4e53-bc6d-b196487fe04c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.668367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:40.673751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 812/1613] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:40 2022] PUT /identity/v3/projects/4d571615e133480ab75456ae998a7767/users/f9c8080755ab4f0f8feac6a2f0cca1c5/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:40.678977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6e94-467c-4068-8401-83e1c2a7db87 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.678977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6e94-467c-4068-8401-83e1c2a7db87 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.679229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6e94-467c-4068-8401-83e1c2a7db87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.704964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-80ee6e94-467c-4068-8401-83e1c2a7db87 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.706277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-80ee6e94-467c-4068-8401-83e1c2a7db87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:40.730596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 802/1614] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:40.730596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e530-50f8-4345-ab48-a1659c1d04c2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.730596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e530-50f8-4345-ab48-a1659c1d04c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.730596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e530-50f8-4345-ab48-a1659c1d04c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.772522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d898e530-50f8-4345-ab48-a1659c1d04c2 None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.773843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d898e530-50f8-4345-ab48-a1659c1d04c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:40.777020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 813/1615] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:40.777872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee6e94-467c-4068-8401-83e1c2a7db87 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.864651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee6e94-467c-4068-8401-83e1c2a7db87 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.867522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 803/1616] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:40.869043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a530a0-8c53-448e-8bc2-0e0eabb3e1e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.869662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a530a0-8c53-448e-8bc2-0e0eabb3e1e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.869969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a530a0-8c53-448e-8bc2-0e0eabb3e1e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.870226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a530a0-8c53-448e-8bc2-0e0eabb3e1e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.876693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e530-50f8-4345-ab48-a1659c1d04c2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.887494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e530-50f8-4345-ab48-a1659c1d04c2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:40.892352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:40.892859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.893142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.893446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] PATH_INFO: `/v3/projects/d2e6c2788a6742fa9a7f86c4d1579171/users/af66b2672d7849e0bf561e046e019933/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.911876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e6c2788a6742fa9a7f86c4d1579171, user_id=af66b2672d7849e0bf561e046e019933, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.914578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.930428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 804/1617] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:40 2022] PUT /identity/v3/projects/d2e6c2788a6742fa9a7f86c4d1579171/users/af66b2672d7849e0bf561e046e019933/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:40.931309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:40.949403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a530a0-8c53-448e-8bc2-0e0eabb3e1e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:40.950975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a530a0-8c53-448e-8bc2-0e0eabb3e1e1 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:40.952187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:40.963069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 814/1618] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:40.964286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2332-4829-42da-8e2c-54b229e1f32a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:40.964696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2332-4829-42da-8e2c-54b229e1f32a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:40.964988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2332-4829-42da-8e2c-54b229e1f32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:40.989079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8b9c2332-4829-42da-8e2c-54b229e1f32a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:40.990771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b9c2332-4829-42da-8e2c-54b229e1f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:41.020536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10507bb-810d-43f3-a2b3-6981954ff96e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.041841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.044155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.045449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.047752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.051012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.052721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:41.055685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.069236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 815/1619] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:41.071264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2332-4829-42da-8e2c-54b229e1f32a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.085154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2332-4829-42da-8e2c-54b229e1f32a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.091048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.092421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.093107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.093600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.094628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.097198 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.123635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 805/1620] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:40 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:41.124589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.130143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:41.150121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 816/1621] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:41 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:41.150121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.218609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce138b5-3067-44bb-a17f-805e3155546b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.253649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3214d-d128-47d2-9b5d-ff56d2b236e7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.270533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.271437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.272031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.272318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.299907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.300644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.301037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.301422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.352400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.353865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.368179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 817/1622] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:41.383722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.392163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.394868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.409172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 806/1623] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:41.412021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.417177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc790-16e4-4cc5-836c-9a906358714b service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.417325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:41.425783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156f66-309a-48a4-b469-126545272cf3 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.431021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.432217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.432970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.433789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.435739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.436395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.436669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.436945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.437818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.439509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.448421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.450400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.469061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 807/1624] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:41.470025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.480504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 818/1625] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:41.481469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.487316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8932462-ecdc-4f07-bc88-134cf32dc6fa service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.493514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.494421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.494858 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.495140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.496060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.499775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.525995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6ae5c-8e27-4db5-8655-fe54c1289115 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.545474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.546281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.548047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.556312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 808/1626] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:41 2022] POST /identity/v3/users => generated 290 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:41.556684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.556684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.557511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.563849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.588993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64cbb4-8ec0-48b1-8552-3d17d4e18157 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.601794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.602607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.603656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.604964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] PATH_INFO: `/v3/projects/d2e6c2788a6742fa9a7f86c4d1579171/users/af66b2672d7849e0bf561e046e019933/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.612125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e6c2788a6742fa9a7f86c4d1579171, user_id=af66b2672d7849e0bf561e046e019933, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.617325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 819/1627] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:41 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:41.617325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.617882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.643320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bad29-c32a-44c6-91cb-0cdd9a55394c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.657573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 809/1628] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:41 2022] PUT /identity/v3/projects/d2e6c2788a6742fa9a7f86c4d1579171/users/af66b2672d7849e0bf561e046e019933/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:41.658463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.756672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:41.816589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec7802-f997-4941-8ac4-a6d5cd221ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.817343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7802-f997-4941-8ac4-a6d5cd221ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.817869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7802-f997-4941-8ac4-a6d5cd221ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.818918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7802-f997-4941-8ac4-a6d5cd221ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.819694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec7802-f997-4941-8ac4-a6d5cd221ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.823603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec7802-f997-4941-8ac4-a6d5cd221ae1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.854784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 820/1629] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:41.857702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fc7a-6f24-4eff-a530-53e8041f748e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.858667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fc7a-6f24-4eff-a530-53e8041f748e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.859347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fc7a-6f24-4eff-a530-53e8041f748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.882395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00009-2434-4c82-8787-bec37dd809f1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.900728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.901355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.901632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.901897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:41.902567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:41.913804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:41.947715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0505fc7a-6f24-4eff-a530-53e8041f748e None None] MFA Rules not processed for user `af66b2672d7849e0bf561e046e019933`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:41.949703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0505fc7a-6f24-4eff-a530-53e8041f748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:41.951086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 810/1630] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:41.953124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:41.973379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e90a-c8e6-4325-9c23-ad4b7963a22b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:41.983850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:41.985623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:41.986171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:41.986559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] PATH_INFO: `/v3/projects/6a56e82952524c5d8c4681a84979fde1/users/2bbeb394fd11422db601e32e303744d2/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.008992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a56e82952524c5d8c4681a84979fde1, user_id=2bbeb394fd11422db601e32e303744d2, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:42.011986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:42.049293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 811/1631] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:41 2022] PUT /identity/v3/projects/6a56e82952524c5d8c4681a84979fde1/users/2bbeb394fd11422db601e32e303744d2/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:42.049293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:42.126978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 821/1632] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:42.126978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e693f9-174a-401d-a11d-f3a390c5b922 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.126978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e693f9-174a-401d-a11d-f3a390c5b922 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.126978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e693f9-174a-401d-a11d-f3a390c5b922 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.139072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 822/1633] 10.222.0.52 () {54 vars in 912 bytes} [Sun Sep 25 04:35:42 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:35:42.139950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e693f9-174a-401d-a11d-f3a390c5b922 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:42.195114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d96b-536d-4c3a-be4f-0b2ccb1815d8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:42.202415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:42.203283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.203580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.203854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.204509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:42.206317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:42.219179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 812/1634] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:42.220282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:42.258200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e693f9-174a-401d-a11d-f3a390c5b922 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:42.265708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:42.269582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c67b-5ba1-4225-944d-befdef383ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:42.270250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c67b-5ba1-4225-944d-befdef383ece admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.270697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c67b-5ba1-4225-944d-befdef383ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.272269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c67b-5ba1-4225-944d-befdef383ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.273013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974c67b-5ba1-4225-944d-befdef383ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:42.275183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974c67b-5ba1-4225-944d-befdef383ece admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:42.288906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 823/1635] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:42.293199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd32bd-bb50-406b-92fe-09e7adb1fb0e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.293488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd32bd-bb50-406b-92fe-09e7adb1fb0e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.293908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd32bd-bb50-406b-92fe-09e7adb1fb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.296691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e573f-1d53-46ec-b6bc-b469dda1b56c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:42.302372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:42.303164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.303499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.303826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.321843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-50dd32bd-bb50-406b-92fe-09e7adb1fb0e None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:42.323557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-50dd32bd-bb50-406b-92fe-09e7adb1fb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:42.382544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:42.416006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:42.418593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:42.422872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 824/1636] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:35:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:42.423919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd32bd-bb50-406b-92fe-09e7adb1fb0e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:42.451863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd32bd-bb50-406b-92fe-09e7adb1fb0e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:42.459635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:42.460784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.461369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.462087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] PATH_INFO: `/v3/projects/7836f24b80db402785cd79fb77276bc9/users/d9d24f1c3f2d4ffd9d2350b7e8c21c02/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.476716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 813/1637] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:42.478980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:42.507045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7836f24b80db402785cd79fb77276bc9, user_id=d9d24f1c3f2d4ffd9d2350b7e8c21c02, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:42.509957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:42.510399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a5132-390f-4b5f-bef7-ad48e4423071 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:42.526863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f0018-8bd9-4a1a-96df-ba364b19ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:42.530478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f0018-8bd9-4a1a-96df-ba364b19ebb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.530771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f0018-8bd9-4a1a-96df-ba364b19ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.533364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f0018-8bd9-4a1a-96df-ba364b19ebb5 admin admin] PATH_INFO: `/v3/projects/6a56e82952524c5d8c4681a84979fde1/users/2bbeb394fd11422db601e32e303744d2/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.549384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 825/1638] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:42 2022] PUT /identity/v3/projects/7836f24b80db402785cd79fb77276bc9/users/d9d24f1c3f2d4ffd9d2350b7e8c21c02/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:42.549384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:42.549655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f0018-8bd9-4a1a-96df-ba364b19ebb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a56e82952524c5d8c4681a84979fde1, user_id=2bbeb394fd11422db601e32e303744d2, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:42.549655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f0018-8bd9-4a1a-96df-ba364b19ebb5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:42.592928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 814/1639] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:42 2022] PUT /identity/v3/projects/6a56e82952524c5d8c4681a84979fde1/users/2bbeb394fd11422db601e32e303744d2/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:42.592928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894083e-ca9f-4aa0-9ba0-dc5fbdd7ce1d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.592928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894083e-ca9f-4aa0-9ba0-dc5fbdd7ce1d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.592928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894083e-ca9f-4aa0-9ba0-dc5fbdd7ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.686219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6faf24-23af-494c-9ada-01f88d0f41e1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:42.689252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e894083e-ca9f-4aa0-9ba0-dc5fbdd7ce1d None None] MFA Rules not processed for user `d9d24f1c3f2d4ffd9d2350b7e8c21c02`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:42.694207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e894083e-ca9f-4aa0-9ba0-dc5fbdd7ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:42.803714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:42.804306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.804586 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.804863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.906051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 815/1640] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:42.909584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6193-7270-4940-9f0d-9be6a6a5e180 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:42.909952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6193-7270-4940-9f0d-9be6a6a5e180 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:42.911197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6193-7270-4940-9f0d-9be6a6a5e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:42.946236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:42.947832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:42.979443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 826/1641] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:42.979993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:42.985101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bffe6193-7270-4940-9f0d-9be6a6a5e180 None None] MFA Rules not processed for user `2bbeb394fd11422db601e32e303744d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:42.988326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bffe6193-7270-4940-9f0d-9be6a6a5e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:43.051133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:43.102497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:43.137345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba0af7-fe11-45e0-bd83-22c7f277037d service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:43.149467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:43.150191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:43.150525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:43.150807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:43.151490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:43.159934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:43.177610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 816/1642] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:43.236344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 827/1643] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:42 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:43.240870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6193-7270-4940-9f0d-9be6a6a5e180 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:43.274627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6193-7270-4940-9f0d-9be6a6a5e180 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:43.314558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:43.434504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9503e-b20b-4785-ac0d-3d7511d2db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:43.436780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9503e-b20b-4785-ac0d-3d7511d2db2c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:43.437259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9503e-b20b-4785-ac0d-3d7511d2db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:43.437551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9503e-b20b-4785-ac0d-3d7511d2db2c admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:43.438239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9503e-b20b-4785-ac0d-3d7511d2db2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:43.440624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9503e-b20b-4785-ac0d-3d7511d2db2c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:43.468871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e98433-8e50-41da-a890-4f578756397d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:43.475809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:43.477478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:43.478005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:43.478576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:43.499563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 817/1644] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:43 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:43.502821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef02d6-bbb9-499a-b069-082a686fffa6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:43.503122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef02d6-bbb9-499a-b069-082a686fffa6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:43.505415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef02d6-bbb9-499a-b069-082a686fffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:43.628143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-68ef02d6-bbb9-499a-b069-082a686fffa6 None None] MFA Rules not processed for user `f9c8080755ab4f0f8feac6a2f0cca1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:43.630471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-68ef02d6-bbb9-499a-b069-082a686fffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:43.669723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:43.671555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:43.683150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 828/1645] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:43.684111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:43.696902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c47546-bd0b-4dc3-8fb7-6322ba8f1305 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:43.719191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:43.721651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:43.722881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:43.723971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:43.726767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:43.730531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:43.755454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 829/1646] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:43.759670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:43.775686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7acc5-263d-4f88-a545-5ffb5dc00caf admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:43.788529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:43.791898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:43.792435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:43.792940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] PATH_INFO: `/v3/projects/62148b5f065d4858bae413d96126de93/users/5f7d9e8cfc604990b25c0b1c28a13d77/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:43.806306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 818/1647] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:43.810797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef02d6-bbb9-499a-b069-082a686fffa6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:43.836127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62148b5f065d4858bae413d96126de93, user_id=5f7d9e8cfc604990b25c0b1c28a13d77, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:43.839708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef02d6-bbb9-499a-b069-082a686fffa6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:43.845739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:43.846404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:43.847843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:43.848121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:43.848885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:43.850748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:43.860099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:43.916970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 830/1648] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:43 2022] PUT /identity/v3/projects/62148b5f065d4858bae413d96126de93/users/5f7d9e8cfc604990b25c0b1c28a13d77/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:43.920998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:43.925263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 819/1649] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:43 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:35:43.925995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:43.974610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:44.019667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8ff34-d817-4a70-899e-64f5c91161f3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:44.051384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:44.099368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9e30-f41e-4d74-8275-ae5be8c6f597 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:44.105499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:44.106122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.106421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.106696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.107611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:44.109901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:44.110502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:44.112038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.112417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.113439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.126635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 820/1650] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:44.128893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:44.153671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c991e-e2f8-4d4c-bc65-619300c04885 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:44.160329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f697a-6b65-49ba-a640-094fd5a331de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:44.161670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f697a-6b65-49ba-a640-094fd5a331de admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.162125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f697a-6b65-49ba-a640-094fd5a331de admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.162867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f697a-6b65-49ba-a640-094fd5a331de admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.163759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f697a-6b65-49ba-a640-094fd5a331de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:44.169469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f697a-6b65-49ba-a640-094fd5a331de admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:44.202237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 821/1651] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:44 2022] POST /identity/v3/users => generated 309 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:44.208314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542142ad-64c8-4060-9135-3a6354bca177 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.209200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542142ad-64c8-4060-9135-3a6354bca177 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.209542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542142ad-64c8-4060-9135-3a6354bca177 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.212676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 822/1652] 10.222.0.52 () {54 vars in 961 bytes} [Sun Sep 25 04:35:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:35:44.213038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542142ad-64c8-4060-9135-3a6354bca177 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:44.219232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:44.223322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:44.229918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542142ad-64c8-4060-9135-3a6354bca177 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:44.235828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:44.238273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.238273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.238828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] PATH_INFO: `/v3/projects/62148b5f065d4858bae413d96126de93/users/5f7d9e8cfc604990b25c0b1c28a13d77/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.242011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62148b5f065d4858bae413d96126de93, user_id=5f7d9e8cfc604990b25c0b1c28a13d77, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:44.245710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:44.270392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 831/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:44.271097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:44.280042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 823/1654] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:44 2022] PUT /identity/v3/projects/62148b5f065d4858bae413d96126de93/users/5f7d9e8cfc604990b25c0b1c28a13d77/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:44.281243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:44.307596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7d66-36d7-4814-a061-30e9075ca5be service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:44.394329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:44.395366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.395650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.395931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] PATH_INFO: `/v3/users/fb302e19a6e64565a706431947214bc2` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.397360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb302e19a6e64565a706431947214bc2)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:44.400106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:44.403170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1ea7b-8b24-4dee-9eef-c75cb202dc41 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:44.416610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad702b-28d5-4317-a8df-bb277977531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:44.417251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad702b-28d5-4317-a8df-bb277977531d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.417535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad702b-28d5-4317-a8df-bb277977531d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.417806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad702b-28d5-4317-a8df-bb277977531d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.418491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad702b-28d5-4317-a8df-bb277977531d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:44.422196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad702b-28d5-4317-a8df-bb277977531d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:44.437535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 824/1655] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:44.438958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.439247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.439526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.480776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:44.481693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:44.485411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:44.508224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb302e19a6e64565a706431947214bc2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:44.526763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb302e19a6e64565a706431947214bc2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:44.528169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb302e19a6e64565a706431947214bc2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:44.528939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb302e19a6e64565a706431947214bc2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:44.549590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-50a04190-66ce-4c3c-9686-5b7fab819e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb302e19a6e64565a706431947214bc2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:44.601052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 832/1656] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:44 2022] DELETE /identity/v3/users/fb302e19a6e64565a706431947214bc2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:44.602802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b5ef-6eb9-42e9-8b51-937efdf83bc9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.603387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b5ef-6eb9-42e9-8b51-937efdf83bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.603774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b5ef-6eb9-42e9-8b51-937efdf83bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.640764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 825/1657] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Sep 25 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:44.641814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:44.644936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:44.664703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5f04b5ef-6eb9-42e9-8b51-937efdf83bc9 None None] MFA Rules not processed for user `5f7d9e8cfc604990b25c0b1c28a13d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:44.666629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980242eb-4c63-4298-98fb-2cf74ea53b20 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:44.668553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5f04b5ef-6eb9-42e9-8b51-937efdf83bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:44.715303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:44.791957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5721-65b6-4231-87dd-743f8cb3f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:44.793484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5721-65b6-4231-87dd-743f8cb3f7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.842595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5721-65b6-4231-87dd-743f8cb3f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.842595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5721-65b6-4231-87dd-743f8cb3f7fb admin admin] PATH_INFO: `/v3/projects/f5862670a3024bd8837afd58ce274761/users/241611b961e7428793ca8b8e0d63e834/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.843580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 833/1658] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:44.843580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c68c01-85a1-42c6-ac4f-d0224c58a280 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.843580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c68c01-85a1-42c6-ac4f-d0224c58a280 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.843580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c68c01-85a1-42c6-ac4f-d0224c58a280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.854670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f5721-65b6-4231-87dd-743f8cb3f7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5862670a3024bd8837afd58ce274761, user_id=241611b961e7428793ca8b8e0d63e834, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:44.862146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f5721-65b6-4231-87dd-743f8cb3f7fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:44.924382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-21c68c01-85a1-42c6-ac4f-d0224c58a280 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:44.935641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-21c68c01-85a1-42c6-ac4f-d0224c58a280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:44.950961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 826/1659] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:44 2022] PUT /identity/v3/projects/f5862670a3024bd8837afd58ce274761/users/241611b961e7428793ca8b8e0d63e834/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:44.952510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa8d7-f441-4f78-ade8-3492d482ca34 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:44.952809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa8d7-f441-4f78-ade8-3492d482ca34 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:44.961882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa8d7-f441-4f78-ade8-3492d482ca34 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:44.967278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 827/1660] 10.222.0.52 () {54 vars in 912 bytes} [Sun Sep 25 04:35:44 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:35:44.969548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa8d7-f441-4f78-ade8-3492d482ca34 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:44.986495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-731aa8d7-f441-4f78-ade8-3492d482ca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:45.073812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 834/1661] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:45.073812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c68c01-85a1-42c6-ac4f-d0224c58a280 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:45.106114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c68c01-85a1-42c6-ac4f-d0224c58a280 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:45.113673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddf410-7de4-4f4f-b21f-4d84093bc2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:45.117032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf410-7de4-4f4f-b21f-4d84093bc2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:45.118517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf410-7de4-4f4f-b21f-4d84093bc2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:45.118640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf410-7de4-4f4f-b21f-4d84093bc2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:45.121068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddf410-7de4-4f4f-b21f-4d84093bc2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:45.127003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddf410-7de4-4f4f-b21f-4d84093bc2f3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:45.144687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa8d7-f441-4f78-ade8-3492d482ca34 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:45.153391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 835/1662] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:45.155161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d9a0-8117-46ad-9b80-c61d4756811e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:45.155452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d9a0-8117-46ad-9b80-c61d4756811e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:45.155728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d9a0-8117-46ad-9b80-c61d4756811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:45.155975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:45.156697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:45.157075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:45.157444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:45.199239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0bd6d9a0-8117-46ad-9b80-c61d4756811e None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:45.200721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0bd6d9a0-8117-46ad-9b80-c61d4756811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:45.233273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:45.271090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:45.272565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:45.315433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 828/1663] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:45.316459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:45.322100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:45.341678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 836/1664] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:35:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:45.351359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6d9a0-8117-46ad-9b80-c61d4756811e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:45.379601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6d9a0-8117-46ad-9b80-c61d4756811e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:45.392662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:45.395578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:45.396191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:45.396569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] PATH_INFO: `/v3/projects/f5862670a3024bd8837afd58ce274761/users/241611b961e7428793ca8b8e0d63e834/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:45.400269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5862670a3024bd8837afd58ce274761, user_id=241611b961e7428793ca8b8e0d63e834, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:45.404530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:45.433873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 837/1665] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:45 2022] PUT /identity/v3/projects/f5862670a3024bd8837afd58ce274761/users/241611b961e7428793ca8b8e0d63e834/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:45.435941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:45.453617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2046216-126a-4e4a-ad02-7c22fd622373 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:45.501815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:45.578773 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:45.579422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:45.579865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:45.580341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:45.602404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d33fd3-08b1-4c0e-9f12-53511689f01e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:45.613779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:45.614664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:45.615097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:45.615517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:45.708724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:45.711597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:45.727751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 829/1666] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:45.729168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:45.731602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:45.751527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0f4d1-241c-444f-ac5d-70173a27fdb7 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:45.760281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7419a-46fd-43f1-aa92-6ef24534cf91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:45.761638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7419a-46fd-43f1-aa92-6ef24534cf91 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:45.762085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7419a-46fd-43f1-aa92-6ef24534cf91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:45.763248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7419a-46fd-43f1-aa92-6ef24534cf91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:45.768129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-47c7419a-46fd-43f1-aa92-6ef24534cf91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:45.791002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:45.792339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:45.830934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 838/1667] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:45.875762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7419a-46fd-43f1-aa92-6ef24534cf91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:45.879388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7419a-46fd-43f1-aa92-6ef24534cf91 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:45.893048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 830/1668] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:46.033435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:46.036181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:46.063503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b691e-ff99-4dbd-a255-3dd6305ea6ca service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:46.077655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:46.079641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:46.080073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:46.080513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] PATH_INFO: `/v3/users/7a305b37b6fc42f2938cf55ea9b1acdc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:46.083990 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a305b37b6fc42f2938cf55ea9b1acdc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:46.088948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:46.181028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:46.196052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a305b37b6fc42f2938cf55ea9b1acdc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:46.219880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a305b37b6fc42f2938cf55ea9b1acdc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:46.220693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a305b37b6fc42f2938cf55ea9b1acdc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:46.221330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a305b37b6fc42f2938cf55ea9b1acdc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:46.267132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a305b37b6fc42f2938cf55ea9b1acdc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:46.309883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 839/1669] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:46 2022] DELETE /identity/v3/users/7a305b37b6fc42f2938cf55ea9b1acdc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:46.314272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:46.314880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:46.315320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:46.363456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:46.364693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:46.579223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 831/1670] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:46.616185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:46.617761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:46.833917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc36a44-ecf8-45ae-b553-c94b20d0f6ec admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:46.838359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a6406-c321-4154-90ca-7dd708a1af63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:46.838996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6406-c321-4154-90ca-7dd708a1af63 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:46.839275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6406-c321-4154-90ca-7dd708a1af63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:46.839548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6406-c321-4154-90ca-7dd708a1af63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:46.869812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a6406-c321-4154-90ca-7dd708a1af63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:46.871307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a6406-c321-4154-90ca-7dd708a1af63 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:46.908907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 840/1671] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:47.315162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:47.317569 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:47.360781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa936ab4-e61d-4def-b13e-5deb1b220982 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:47.391590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:47.392383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:47.392670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:47.395292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] PATH_INFO: `/v3/projects/409732498552405fb683310ed8fa5743` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:47.401191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=409732498552405fb683310ed8fa5743)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:47.407397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:47.412557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:47.517493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:47.517792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:47.518073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:47.559644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409732498552405fb683310ed8fa5743', 'request_id': 'req-71a0bcf6-6ece-400d-8376-797e88d7ad62'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.575295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409732498552405fb683310ed8fa5743', 'request_id': 'req-71a0bcf6-6ece-400d-8376-797e88d7ad62'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.588862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] MFA Rules not processed for user `241611b961e7428793ca8b8e0d63e834`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:47.590904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:47.595737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409732498552405fb683310ed8fa5743', 'request_id': 'req-71a0bcf6-6ece-400d-8376-797e88d7ad62'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.622086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] The token cache is being invalidate because project 409732498552405fb683310ed8fa5743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:47.622500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.626301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.633287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 832/1672] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:47 2022] DELETE /identity/v3/projects/409732498552405fb683310ed8fa5743 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:47.634365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:47.637196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:47.795462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 841/1673] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:47.802187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bcf6-6ece-400d-8376-797e88d7ad62 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:47.809710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:47.810516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:47.810988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:47.811385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] PATH_INFO: `/v3/users/af66b2672d7849e0bf561e046e019933` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:47.813172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af66b2672d7849e0bf561e046e019933)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:47.814312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:35:47.814312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 25 04:35:47.814312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: Sep 25 04:35:47.817173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:47.944287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af66b2672d7849e0bf561e046e019933'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.946897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af66b2672d7849e0bf561e046e019933'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.969467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af66b2672d7849e0bf561e046e019933'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:47.994152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af66b2672d7849e0bf561e046e019933'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:48.068845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c4a915a2-e909-4e22-99f7-7bc9849b352f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af66b2672d7849e0bf561e046e019933'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:48.087409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 833/1674] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:47 2022] DELETE /identity/v3/users/af66b2672d7849e0bf561e046e019933 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:35:48.456950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:48.458469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:48.487026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3053-d549-45a3-a3f8-9d8008250b58 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:48.648345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:48.701395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:48.702229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:48.703040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:48.705064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] PATH_INFO: `/v3/projects/d5a1b9fad1744e4694fde82b0b63fe5d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:48.719243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a1b9fad1744e4694fde82b0b63fe5d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:48.719243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 04:35:48.719243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: warnings.warn(msg) Sep 25 04:35:48.719243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: Sep 25 04:35:48.719243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:49.004450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a1b9fad1744e4694fde82b0b63fe5d', 'request_id': 'req-a89e5da7-91cf-496e-abd4-a5b82473b400'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:49.062834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a1b9fad1744e4694fde82b0b63fe5d', 'request_id': 'req-a89e5da7-91cf-496e-abd4-a5b82473b400'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:49.077157 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a1b9fad1744e4694fde82b0b63fe5d', 'request_id': 'req-a89e5da7-91cf-496e-abd4-a5b82473b400'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:49.129352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] The token cache is being invalidate because project d5a1b9fad1744e4694fde82b0b63fe5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:49.131443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:49.132444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a89e5da7-91cf-496e-abd4-a5b82473b400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:49.134723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 842/1675] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:48 2022] DELETE /identity/v3/projects/d5a1b9fad1744e4694fde82b0b63fe5d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:49.140721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c36f1-36df-42c5-8312-f7555a55f925 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.140721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c36f1-36df-42c5-8312-f7555a55f925 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.140721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c36f1-36df-42c5-8312-f7555a55f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.172028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a24c36f1-36df-42c5-8312-f7555a55f925 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:49.173832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a24c36f1-36df-42c5-8312-f7555a55f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:49.187846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:49.316576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973d96-0fc4-4063-a705-3de3ff3d7a0f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.316862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973d96-0fc4-4063-a705-3de3ff3d7a0f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.317171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973d96-0fc4-4063-a705-3de3ff3d7a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.328073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 834/1676] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:49.356612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-63973d96-0fc4-4063-a705-3de3ff3d7a0f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:49.358000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-63973d96-0fc4-4063-a705-3de3ff3d7a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:49.386700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 843/1677] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:49.388652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c36f1-36df-42c5-8312-f7555a55f925 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:49.404890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c36f1-36df-42c5-8312-f7555a55f925 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:49.421405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e6f7e-212b-4173-9d60-11b5486b6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:49.422434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e6f7e-212b-4173-9d60-11b5486b6df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.423053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e6f7e-212b-4173-9d60-11b5486b6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.423480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e6f7e-212b-4173-9d60-11b5486b6df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.424839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e6f7e-212b-4173-9d60-11b5486b6df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:49.425831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e6f7e-212b-4173-9d60-11b5486b6df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:49.430213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e6f7e-212b-4173-9d60-11b5486b6df1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:49.468633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 835/1678] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:49.470481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973d96-0fc4-4063-a705-3de3ff3d7a0f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:49.483863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973d96-0fc4-4063-a705-3de3ff3d7a0f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:49.498882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0dd76-135a-421f-a41a-6efbc2ee1bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:49.499510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0dd76-135a-421f-a41a-6efbc2ee1bea admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.499842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0dd76-135a-421f-a41a-6efbc2ee1bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.500134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0dd76-135a-421f-a41a-6efbc2ee1bea admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.500763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0dd76-135a-421f-a41a-6efbc2ee1bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:49.502973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0dd76-135a-421f-a41a-6efbc2ee1bea admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:49.551967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a2ed-d21f-4726-a436-cdd3a3f72042 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.552300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a2ed-d21f-4726-a436-cdd3a3f72042 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.552746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a2ed-d21f-4726-a436-cdd3a3f72042 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.555169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 836/1679] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:35:49.563664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 844/1680] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:49 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:35:49.565327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a2ed-d21f-4726-a436-cdd3a3f72042 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:49.581882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.582240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.582986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.627552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:49.629365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:49.740587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a2ed-d21f-4726-a436-cdd3a3f72042 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:49.759951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:49.760680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.762039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.762990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.764241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:49.767230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:49.767654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 845/1681] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:35:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:49.777609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:49.779197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:49.805615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d4039-4c6d-45c0-a0c8-979fe9f6eb44 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:49.816268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:49.817070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.817506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.821761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] PATH_INFO: `/v3/projects/d2e6c2788a6742fa9a7f86c4d1579171` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.825155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 837/1682] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:49 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:49.825343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e6c2788a6742fa9a7f86c4d1579171)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:49.827297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:49.830938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:49.856532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc95e8-42e2-45e6-a10b-d1ce8b5d1381 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:49.867750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:49.868380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:49.868659 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:49.868928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:49.869585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:49.875229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:49.909288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 838/1683] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:49.914648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:49.927472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:49.958207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f97189-be59-49a4-82b4-d916dd8f1257 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:49.963946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e6c2788a6742fa9a7f86c4d1579171', 'request_id': 'req-3dcaed31-ff25-43b4-8e8f-5114a8acd766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:49.990965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e6c2788a6742fa9a7f86c4d1579171', 'request_id': 'req-3dcaed31-ff25-43b4-8e8f-5114a8acd766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.012258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e6c2788a6742fa9a7f86c4d1579171', 'request_id': 'req-3dcaed31-ff25-43b4-8e8f-5114a8acd766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.047547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] The token cache is being invalidate because project d2e6c2788a6742fa9a7f86c4d1579171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:50.048392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.050558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3dcaed31-ff25-43b4-8e8f-5114a8acd766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.057864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 846/1684] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:49 2022] DELETE /identity/v3/projects/d2e6c2788a6742fa9a7f86c4d1579171 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:50.063640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.064037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.064220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.132947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:50.140614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.200341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:50.201081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.201383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.201640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.202305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:50.206890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:50.241466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 839/1685] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:50.241466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:50.247248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.275766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:50.336430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 847/1686] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:50.337348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:50.338799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.361193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e6dfe-f801-48c7-be3d-027d51b8f376 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:50.368928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:50.369983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.371017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.371017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] PATH_INFO: `/v3/users/71a6aff0e0134b66a77c751b3d8a9337` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.372919 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a6aff0e0134b66a77c751b3d8a9337)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:50.375275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:50.389791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46972525-8984-4f43-a1e1-d3ff25b86c3c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:50.396355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:50.397075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.397453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.398295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.400282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.416057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:50.418341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:50.438261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 840/1687] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:50.439118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:50.443465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.457300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a6aff0e0134b66a77c751b3d8a9337'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.466747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ba23e-de3b-4f98-8db9-02181f16919b service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:50.473945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:50.474838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.474972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.475241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] PATH_INFO: `/v3/projects/f8c4669ff3474917b975f59dfc9dd49b/users/8f2c1a0a6e6947f3962a559edc5d713c/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.509093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a6aff0e0134b66a77c751b3d8a9337'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.510600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a6aff0e0134b66a77c751b3d8a9337'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.511645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a6aff0e0134b66a77c751b3d8a9337'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.536126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c4669ff3474917b975f59dfc9dd49b, user_id=8f2c1a0a6e6947f3962a559edc5d713c, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:50.538895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:50.541109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4bb5109a-ea90-4630-92e1-8770def7e1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a6aff0e0134b66a77c751b3d8a9337'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.568287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 841/1688] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:50 2022] PUT /identity/v3/projects/f8c4669ff3474917b975f59dfc9dd49b/users/8f2c1a0a6e6947f3962a559edc5d713c/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:50.569667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:50.576341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.587019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 848/1689] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:50 2022] DELETE /identity/v3/users/71a6aff0e0134b66a77c751b3d8a9337 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:50.591792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc19fd-d9eb-497e-99c8-b670a306a7d5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.592086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc19fd-d9eb-497e-99c8-b670a306a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.592367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc19fd-d9eb-497e-99c8-b670a306a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.618113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8dbc19fd-d9eb-497e-99c8-b670a306a7d5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:50.619255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8dbc19fd-d9eb-497e-99c8-b670a306a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.680864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a302-6433-4959-9e83-f830fc5c75b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:50.686336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:50.750061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 849/1690] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:50.751550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ce4d-6b04-42a4-9447-79edcf0d4aa1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.751852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ce4d-6b04-42a4-9447-79edcf0d4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.752138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ce4d-6b04-42a4-9447-79edcf0d4aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.782611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:50.783639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.784232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.784889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] PATH_INFO: `/v3/users/c7c2260cb6e643bcb63712c665144761` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.786251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c2260cb6e643bcb63712c665144761)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:50.788788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:50.800649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6e99ce4d-6b04-42a4-9447-79edcf0d4aa1 None None] MFA Rules not processed for user `8f2c1a0a6e6947f3962a559edc5d713c`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:50.801929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6e99ce4d-6b04-42a4-9447-79edcf0d4aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.850299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:50.884117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c2260cb6e643bcb63712c665144761'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.884798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c2260cb6e643bcb63712c665144761'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.895769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c2260cb6e643bcb63712c665144761'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.897265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 850/1691] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:50.898690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:50.898984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:50.899265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:50.912485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c2260cb6e643bcb63712c665144761'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.920616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:50.921850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.934893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c2260cb6e643bcb63712c665144761'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:50.943704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 851/1692] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:50.944727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:50.945759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 842/1693] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:50 2022] DELETE /identity/v3/users/c7c2260cb6e643bcb63712c665144761 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:50.946734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.947738 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:50.949379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:50.967767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d78bde-2d52-4f38-a199-1a877fc8ca06 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.039110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836598-ad80-4a86-ba23-7af154347bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.039746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836598-ad80-4a86-ba23-7af154347bba admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.040027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836598-ad80-4a86-ba23-7af154347bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.040305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836598-ad80-4a86-ba23-7af154347bba admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.040966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836598-ad80-4a86-ba23-7af154347bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:51.041271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836598-ad80-4a86-ba23-7af154347bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.042907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836598-ad80-4a86-ba23-7af154347bba admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.052362 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2865a-3fda-4257-83a9-2eaa898a3137 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.075523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 852/1694] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:51.075805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.075805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.075805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.075805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.076116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.077280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.080528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.083488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.083943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.112321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:51.113851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:51.124793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 853/1695] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:51.125493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.126850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:51.132527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 843/1696] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:50 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:51.132527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.238018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83bb4b-b67e-4b5e-8291-32e8b1f8dea9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.239970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeeb88-69d1-4cc2-9a56-1ca4ef93fd11 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.242938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:51.247851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.248562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.248852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.249128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.250236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.252319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.311910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 844/1697] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:51 2022] POST /identity/v3/projects => generated 355 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:51.313419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.320405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.321341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.321617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.322267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.333908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.336820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.351150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:51.360902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 854/1698] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:51.361804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.381275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd930-8b2d-4df3-a532-78db23a52125 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.476898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0cb7-627b-41b4-851e-caa525c5c18d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.490073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.491318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.491318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.491505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.493227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.497150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.526428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6ef27-690e-45b5-a574-f23faead3ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.527376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6ef27-690e-45b5-a574-f23faead3ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.527971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6ef27-690e-45b5-a574-f23faead3ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.528494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6ef27-690e-45b5-a574-f23faead3ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.542404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6ef27-690e-45b5-a574-f23faead3ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.544083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6ef27-690e-45b5-a574-f23faead3ba5 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.547869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 845/1699] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:51 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:51.551534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.576251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba015bcc-ac07-4455-a6e8-2c1ffde12540 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.578801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 855/1700] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:51.583011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7929c-22bc-404a-b2fe-a17d3d2f9dae None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.585498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7929c-22bc-404a-b2fe-a17d3d2f9dae None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.585794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7929c-22bc-404a-b2fe-a17d3d2f9dae None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.588863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 856/1701] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:35:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:35:51.589686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7929c-22bc-404a-b2fe-a17d3d2f9dae None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.592971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379186a-b9f3-4faa-a27d-15f0fb22d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.593623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379186a-b9f3-4faa-a27d-15f0fb22d215 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.593912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379186a-b9f3-4faa-a27d-15f0fb22d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.594196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379186a-b9f3-4faa-a27d-15f0fb22d215 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.595101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379186a-b9f3-4faa-a27d-15f0fb22d215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.599726 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379186a-b9f3-4faa-a27d-15f0fb22d215 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.628899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7929c-22bc-404a-b2fe-a17d3d2f9dae None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.646997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.650544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.650544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.650544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.650544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.655113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.659985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 846/1702] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:51 2022] POST /identity/v3/users => generated 278 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:51.664543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.666047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.666047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.683465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 857/1703] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:51.685235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.689674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:51.709925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493fca9-1347-4588-870a-6378d531e1ce admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.718006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.719169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.719726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.720201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] PATH_INFO: `/v3/users/f9c8080755ab4f0f8feac6a2f0cca1c5` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.721893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c8080755ab4f0f8feac6a2f0cca1c5)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.725130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.728348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:51.734844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:51.823079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c8080755ab4f0f8feac6a2f0cca1c5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:51.835648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c8080755ab4f0f8feac6a2f0cca1c5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:51.849549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c8080755ab4f0f8feac6a2f0cca1c5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:51.851626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c8080755ab4f0f8feac6a2f0cca1c5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:51.867691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 847/1704] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:35:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:51.869491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.872110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c8080755ab4f0f8feac6a2f0cca1c5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:51.872753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:51.897105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5cb97-bd09-4e94-ac40-44ccdad2250d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.908952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:51.911520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:51.911668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:51.912019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:51.913775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:51.916224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:51.937649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 848/1705] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:51.939289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.939590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 858/1706] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:51 2022] DELETE /identity/v3/users/f9c8080755ab4f0f8feac6a2f0cca1c5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:51.943579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:51.944233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:51.947096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:51.965544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084cd34-a206-4cbd-95b7-b09b28a4c8ac admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:51.988030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:52.096452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:52.097462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.097749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.098025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] PATH_INFO: `/v3/projects/c24728a76d3d4d178405484915cbc6bd/users/6836dfc4a3884acda7248849d53234d7/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.127407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fae9-5b82-41a3-8b40-1079e8b4176a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:52.132090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24728a76d3d4d178405484915cbc6bd, user_id=6836dfc4a3884acda7248849d53234d7, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:52.137208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:52.141630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:52.143784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:52.144773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.145064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.145330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.170588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 849/1707] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:51 2022] PUT /identity/v3/projects/c24728a76d3d4d178405484915cbc6bd/users/6836dfc4a3884acda7248849d53234d7/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:52.171555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:52.172777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:52.174433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:52.202982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 859/1708] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:52.216971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:52.268372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95d40-3329-4058-9ef5-f172b1e35ead service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:52.301226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2de49-97ab-46c9-a7dc-1b2fa38b0989 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:52.316163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:52.316780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.317067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.317353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.318332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:52.323295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:52.348014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 850/1709] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:52.349150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:52.373259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01cd7-aa18-4604-ba39-aba97c05712f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:52.389014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23572350-ef1f-44bb-a0ca-7394acfc4a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:52.391246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572350-ef1f-44bb-a0ca-7394acfc4a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.392458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572350-ef1f-44bb-a0ca-7394acfc4a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.393079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572350-ef1f-44bb-a0ca-7394acfc4a5b admin admin] PATH_INFO: `/v3/projects/c8a636df0452431b8bb07d8c50bea2ff/users/a0b0b8c8f92649a490270f18c2f45921/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.419494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:52.420139 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.420421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.420696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.421357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:52.427551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:52.431100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23572350-ef1f-44bb-a0ca-7394acfc4a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a636df0452431b8bb07d8c50bea2ff, user_id=a0b0b8c8f92649a490270f18c2f45921, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:52.441632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23572350-ef1f-44bb-a0ca-7394acfc4a5b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:52.457692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 860/1710] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:52.458960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:52.485052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 851/1711] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:52 2022] PUT /identity/v3/projects/c8a636df0452431b8bb07d8c50bea2ff/users/a0b0b8c8f92649a490270f18c2f45921/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:52.492456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce81a-250a-4c23-9d6d-99c3417f1e57 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.493252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce81a-250a-4c23-9d6d-99c3417f1e57 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.493375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce81a-250a-4c23-9d6d-99c3417f1e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.501395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d088ba-cfa2-43c5-84bd-2dc5a5db0c36 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:52.559681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-064ce81a-250a-4c23-9d6d-99c3417f1e57 None None] MFA Rules not processed for user `a0b0b8c8f92649a490270f18c2f45921`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:52.564453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-064ce81a-250a-4c23-9d6d-99c3417f1e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:52.649172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47869b6-29fc-4d38-afb2-8797acdac23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:52.651379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47869b6-29fc-4d38-afb2-8797acdac23b admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.651769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47869b6-29fc-4d38-afb2-8797acdac23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.655717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47869b6-29fc-4d38-afb2-8797acdac23b admin admin] PATH_INFO: `/v3/projects/c24728a76d3d4d178405484915cbc6bd/users/6836dfc4a3884acda7248849d53234d7/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.661302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47869b6-29fc-4d38-afb2-8797acdac23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24728a76d3d4d178405484915cbc6bd, user_id=6836dfc4a3884acda7248849d53234d7, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:52.672401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47869b6-29fc-4d38-afb2-8797acdac23b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:52.709900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 861/1712] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:52 2022] PUT /identity/v3/projects/c24728a76d3d4d178405484915cbc6bd/users/6836dfc4a3884acda7248849d53234d7/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:52.713116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337064-777c-4939-a357-6d2a00d3e37c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.713329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337064-777c-4939-a357-6d2a00d3e37c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.713571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337064-777c-4939-a357-6d2a00d3e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.721531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 852/1713] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:52.724642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce81a-250a-4c23-9d6d-99c3417f1e57 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:52.743287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce81a-250a-4c23-9d6d-99c3417f1e57 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:52.785746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4a337064-777c-4939-a357-6d2a00d3e37c None None] MFA Rules not processed for user `6836dfc4a3884acda7248849d53234d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:52.790991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4a337064-777c-4939-a357-6d2a00d3e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:52.833304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:52.843670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:52.845194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:52.845742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:52.846329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:52.848655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:52.851900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:52.853707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:52.938962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 853/1714] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:52 2022] POST /identity/v3/projects => generated 357 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:52.939991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:52.942731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:53.017189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 862/1715] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:35:53.018227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a337064-777c-4939-a357-6d2a00d3e37c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:53.051275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a337064-777c-4939-a357-6d2a00d3e37c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:53.118376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901159a5-3c44-4046-b8fc-6b36ed6b46a0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:53.128793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:53.129508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:53.129801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:53.130080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] PATH_INFO: `/v3/projects/4d571615e133480ab75456ae998a7767` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:53.131701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d571615e133480ab75456ae998a7767)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:53.139021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:53.203274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:53.203736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:53.204141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:53.205945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:53.207769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:53.213927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:53.248736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 863/1716] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:53 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:53.248736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:53.251116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:53.263724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d571615e133480ab75456ae998a7767', 'request_id': 'req-4fff2620-81ef-460e-8dae-c0a77117f63e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.272734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f0e5-386d-4a92-92f2-6e54059072bb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:53.283230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d571615e133480ab75456ae998a7767', 'request_id': 'req-4fff2620-81ef-460e-8dae-c0a77117f63e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.305680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d571615e133480ab75456ae998a7767', 'request_id': 'req-4fff2620-81ef-460e-8dae-c0a77117f63e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.330082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] The token cache is being invalidate because project 4d571615e133480ab75456ae998a7767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:53.332127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.333198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.335816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 854/1717] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:52 2022] DELETE /identity/v3/projects/4d571615e133480ab75456ae998a7767 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:53.336644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:53.341399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:53.414278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:53.423774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:53.424262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:53.424581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] PATH_INFO: `/v3/projects/04336b4838794993bdcb18437b260be5` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:53.426153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04336b4838794993bdcb18437b260be5)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:53.428519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:53.477619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2620-81ef-460e-8dae-c0a77117f63e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:53.489633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:53.492233 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:53.492661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:53.493019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:53.497369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:53.548138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04336b4838794993bdcb18437b260be5', 'request_id': 'req-23761b97-03ea-4d8c-b376-5705f4e63d9c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.550204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:53.561275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:53.571423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04336b4838794993bdcb18437b260be5', 'request_id': 'req-23761b97-03ea-4d8c-b376-5705f4e63d9c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.592272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04336b4838794993bdcb18437b260be5', 'request_id': 'req-23761b97-03ea-4d8c-b376-5705f4e63d9c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.612777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] The token cache is being invalidate because project 04336b4838794993bdcb18437b260be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:53.613465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.614611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.621436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 864/1718] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:53 2022] DELETE /identity/v3/projects/04336b4838794993bdcb18437b260be5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:53.621436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:53.624399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:53.653035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:53.660528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:53.678486 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 855/1719] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:53.692540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:53.700480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:53.734593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b91d-6985-4dbe-90a7-b7678f9df14c service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:53.776327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23761b97-03ea-4d8c-b376-5705f4e63d9c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:53.785488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:53.787754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:53.788003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:53.788273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:53.788935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:53.795587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:53.827318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 865/1720] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:53.828199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:53.833008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:53.866856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77e036-2e9b-4b66-9eca-92e8905e0ea2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:53.873228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:53.874050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:53.874582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:53.874959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] PATH_INFO: `/v3/users/241611b961e7428793ca8b8e0d63e834` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:53.876366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=241611b961e7428793ca8b8e0d63e834)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:53.878532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:53.880855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:53.884257 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:53.884546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:53.884828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] PATH_INFO: `/v3/projects/a29b552b1bef4407a420ab24fd3aa8e2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:53.890833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29b552b1bef4407a420ab24fd3aa8e2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:53.897964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:53.951570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241611b961e7428793ca8b8e0d63e834'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.965753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241611b961e7428793ca8b8e0d63e834'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.966701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241611b961e7428793ca8b8e0d63e834'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.967939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241611b961e7428793ca8b8e0d63e834'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.988424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29b552b1bef4407a420ab24fd3aa8e2', 'request_id': 'req-2046ca41-d24e-46d8-a786-4d6b8ece7624'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.991547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241611b961e7428793ca8b8e0d63e834'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:53.997867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29b552b1bef4407a420ab24fd3aa8e2', 'request_id': 'req-2046ca41-d24e-46d8-a786-4d6b8ece7624'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.011413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29b552b1bef4407a420ab24fd3aa8e2', 'request_id': 'req-2046ca41-d24e-46d8-a786-4d6b8ece7624'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.031677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] The token cache is being invalidate because project a29b552b1bef4407a420ab24fd3aa8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:54.032107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.032983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.035319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 856/1721] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:53 2022] DELETE /identity/v3/projects/a29b552b1bef4407a420ab24fd3aa8e2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:54.036358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:54.037891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:54.047785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 866/1722] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:53 2022] DELETE /identity/v3/users/241611b961e7428793ca8b8e0d63e834 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:54.050960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:54.061876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:54.117445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.136264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ca41-d24e-46d8-a786-4d6b8ece7624 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:54.191938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.204839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0de38-dc76-49b2-8302-f174e37e77b7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:54.216839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:54.218683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:54.219444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:54.220058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:54.226526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:54.266081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:54.266952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:54.267237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:54.268673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] PATH_INFO: `/v3/users/2bbeb394fd11422db601e32e303744d2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:54.269868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bbeb394fd11422db601e32e303744d2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:54.272028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:54.380730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:54.382429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:54.386805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bbeb394fd11422db601e32e303744d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.388128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bbeb394fd11422db601e32e303744d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.416515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bbeb394fd11422db601e32e303744d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.430654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 867/1723] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:54.434744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:54.437707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:54.445508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bbeb394fd11422db601e32e303744d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.468029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3bee9650-8d2c-4613-8ceb-b63396a9397d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bbeb394fd11422db601e32e303744d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:54.486965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549015c-2531-4ecc-9c67-6d0a052fa4d7 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:54.493221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:54.494072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:54.494452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:54.494793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] PATH_INFO: `/v3/projects/d6acbe9a120c45ff9b8536f0a487d2b0/users/9246b0dbde184867ba4c65b01fe47e3f/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:54.497063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 857/1724] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:54 2022] DELETE /identity/v3/users/2bbeb394fd11422db601e32e303744d2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:54.502630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:54.503159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:54.503377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:54.608663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6acbe9a120c45ff9b8536f0a487d2b0, user_id=9246b0dbde184867ba4c65b01fe47e3f, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:54.619437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:54.641889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] MFA Rules not processed for user `5bdeb69b2259462b90c34aede652f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:54.643251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:54.652926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 868/1725] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:54 2022] PUT /identity/v3/projects/d6acbe9a120c45ff9b8536f0a487d2b0/users/9246b0dbde184867ba4c65b01fe47e3f/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:54.655230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:54.657799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:54.839239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 858/1726] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:54.855473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:54.857287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:54.859604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b49af-3b8e-4468-a230-ae420aa6c350 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:54.873181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:54.873906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:54.874197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:54.874509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] PATH_INFO: `/v3/users/d9d24f1c3f2d4ffd9d2350b7e8c21c02` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:54.875687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d24f1c3f2d4ffd9d2350b7e8c21c02)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:54.877671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:54.885047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125e40e-d9ea-4217-8190-3b6b2a0f43c8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:54.896521 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:54.897184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:54.897465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:54.897740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] PATH_INFO: `/v3/projects/f5862670a3024bd8837afd58ce274761` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:54.898960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5862670a3024bd8837afd58ce274761)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:54.900921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:54.903884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:55.012493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d24f1c3f2d4ffd9d2350b7e8c21c02'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.032615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d24f1c3f2d4ffd9d2350b7e8c21c02'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.034727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d24f1c3f2d4ffd9d2350b7e8c21c02'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.035566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d24f1c3f2d4ffd9d2350b7e8c21c02'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.038495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5862670a3024bd8837afd58ce274761', 'request_id': 'req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.055740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d24f1c3f2d4ffd9d2350b7e8c21c02'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.068769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5862670a3024bd8837afd58ce274761', 'request_id': 'req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.094026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5862670a3024bd8837afd58ce274761', 'request_id': 'req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.100877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:55.130041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 869/1727] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:54 2022] DELETE /identity/v3/users/d9d24f1c3f2d4ffd9d2350b7e8c21c02 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:55.138187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:55.140021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] The token cache is being invalidate because project f5862670a3024bd8837afd58ce274761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:55.140317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.141334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-866e65b3-9483-41aa-a1fb-f1f7cdf709a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.144485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.151654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 859/1728] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:54 2022] DELETE /identity/v3/projects/f5862670a3024bd8837afd58ce274761 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:55.153609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.153899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.154174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.214108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] MFA Rules not processed for user `5bdeb69b2259462b90c34aede652f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:55.215617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.277143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71ce5a-82e5-41b1-9b50-5320c2c27f8b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:55.284815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e554-fe98-43d7-bae1-3840c95aefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:55.286857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e554-fe98-43d7-bae1-3840c95aefa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.287399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e554-fe98-43d7-bae1-3840c95aefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.287888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e554-fe98-43d7-bae1-3840c95aefa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.288773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e554-fe98-43d7-bae1-3840c95aefa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:55.291323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e554-fe98-43d7-bae1-3840c95aefa8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:55.314789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 870/1729] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:55.318813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.319740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.320120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.374685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 860/1730] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:55.379706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:55.380436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:55.381848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.384603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.420282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 871/1731] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:55.420282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:55.420282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.421067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1f890-66b3-4028-992b-f4520af77054 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:55.433182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:55.433182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.433496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.433693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] PATH_INFO: `/v3/projects/6a56e82952524c5d8c4681a84979fde1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.436277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a56e82952524c5d8c4681a84979fde1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:55.438794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b9661-e19e-4ed8-b711-70e09e893a64 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:55.440382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:55.461118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:55.461819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.462102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.462437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] PATH_INFO: `/v3/projects/d6acbe9a120c45ff9b8536f0a487d2b0/users/9246b0dbde184867ba4c65b01fe47e3f/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.468378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6acbe9a120c45ff9b8536f0a487d2b0, user_id=9246b0dbde184867ba4c65b01fe47e3f, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:55.473241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:55.499540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 872/1732] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:55 2022] PUT /identity/v3/projects/d6acbe9a120c45ff9b8536f0a487d2b0/users/9246b0dbde184867ba4c65b01fe47e3f/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:55.500209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:55.510813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.560987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a56e82952524c5d8c4681a84979fde1', 'request_id': 'req-2764a223-f587-4636-82b9-4bdd5f034bb4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.573630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a56e82952524c5d8c4681a84979fde1', 'request_id': 'req-2764a223-f587-4636-82b9-4bdd5f034bb4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.600590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a56e82952524c5d8c4681a84979fde1', 'request_id': 'req-2764a223-f587-4636-82b9-4bdd5f034bb4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.625511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] The token cache is being invalidate because project 6a56e82952524c5d8c4681a84979fde1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:55.626001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.626839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2764a223-f587-4636-82b9-4bdd5f034bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.629519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 861/1733] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:55 2022] DELETE /identity/v3/projects/6a56e82952524c5d8c4681a84979fde1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:55.630794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.631084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.631361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.674318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:55.676203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.705646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a162e-f6d7-4f38-82de-188f6dacba6f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:55.715713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:55.843512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 862/1734] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:55.844511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:55.849772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.883096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d35c4-3523-49bf-babb-522e478c9baa None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:55.883242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4c601-55d1-4626-ad6f-152750a77686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:55.883877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4c601-55d1-4626-ad6f-152750a77686 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.884201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4c601-55d1-4626-ad6f-152750a77686 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.885094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4c601-55d1-4626-ad6f-152750a77686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.888086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-eda4c601-55d1-4626-ad6f-152750a77686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:55.888451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:55.889148 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:55.889435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:55.889767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] PATH_INFO: `/v3/users/6d84e145672f4032ae8f6443278b75ab` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:55.890976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d84e145672f4032ae8f6443278b75ab)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:55.893282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:55.897848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:55.993693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d84e145672f4032ae8f6443278b75ab'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:55.994592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d84e145672f4032ae8f6443278b75ab'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.001051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4c601-55d1-4626-ad6f-152750a77686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:56.005221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4c601-55d1-4626-ad6f-152750a77686 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:56.008620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d84e145672f4032ae8f6443278b75ab'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.021596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 873/1735] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:56.039076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.039363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.039646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.039751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d84e145672f4032ae8f6443278b75ab'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.075886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6d544a4-7aa9-4bc2-a757-a783f655f344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d84e145672f4032ae8f6443278b75ab'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.090086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 863/1736] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:55 2022] DELETE /identity/v3/users/6d84e145672f4032ae8f6443278b75ab => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:56.092678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce281c75-20de-43da-ace0-904673b40013 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.095509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce281c75-20de-43da-ace0-904673b40013 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.095972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce281c75-20de-43da-ace0-904673b40013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.107284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] MFA Rules not processed for user `9246b0dbde184867ba4c65b01fe47e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:56.108846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.169686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ce281c75-20de-43da-ace0-904673b40013 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:56.171248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ce281c75-20de-43da-ace0-904673b40013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.246004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 874/1737] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:56.247031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:56.248478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.305828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 864/1738] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:56.307546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.308034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.308156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.365198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] MFA Rules not processed for user `f71ca39699984435ba165b5c24ee81a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:56.366527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.407114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:56.451270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74ca3-933f-4f2b-9b45-ae85530415b6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:56.469761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736fd2b-06c9-41b8-a6b8-b19cde11bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:56.477145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736fd2b-06c9-41b8-a6b8-b19cde11bc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.477601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736fd2b-06c9-41b8-a6b8-b19cde11bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.478558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736fd2b-06c9-41b8-a6b8-b19cde11bc2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.481130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736fd2b-06c9-41b8-a6b8-b19cde11bc2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:56.482366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736fd2b-06c9-41b8-a6b8-b19cde11bc2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:56.484506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736fd2b-06c9-41b8-a6b8-b19cde11bc2e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:56.515718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 865/1739] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:56.515718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:56.515718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.548586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59918d57-5123-4370-ba95-c6efbb262202 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:56.551161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 875/1740] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:56.555091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.555696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.556307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.556869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:56.557756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.558119 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.558511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] PATH_INFO: `/v3/projects/7836f24b80db402785cd79fb77276bc9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.561433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7836f24b80db402785cd79fb77276bc9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:56.564533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:56.611119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:56.614597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.634521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 876/1741] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:56.647326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:56.651312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.704131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7836f24b80db402785cd79fb77276bc9', 'request_id': 'req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.725063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7836f24b80db402785cd79fb77276bc9', 'request_id': 'req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.734316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:56.741357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7836f24b80db402785cd79fb77276bc9', 'request_id': 'req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.761096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] The token cache is being invalidate because project 7836f24b80db402785cd79fb77276bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:56.761281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.761932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d03edd18-8efb-47ad-b0ca-a8181f70ed1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:56.764006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 866/1742] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:56 2022] DELETE /identity/v3/projects/7836f24b80db402785cd79fb77276bc9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:56.765827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834607c-4685-4a96-9396-89df878e46f6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.766131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834607c-4685-4a96-9396-89df878e46f6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.766752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834607c-4685-4a96-9396-89df878e46f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.829830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7834607c-4685-4a96-9396-89df878e46f6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:56.831869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7834607c-4685-4a96-9396-89df878e46f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.851584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b625c0-f3cd-47c6-87a2-ddaca0ed1050 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:56.941860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:56.942626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.942997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.943338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.945482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:56.951108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 867/1743] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:56.952993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:56.952993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:56.953276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:56.991649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] MFA Rules not processed for user `f71ca39699984435ba165b5c24ee81a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:56.993170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.059446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:57.059647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:57.061882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:57.085312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 877/1744] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:57.086177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:57.091548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.109373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 868/1745] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:57.110154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:57.111744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373980-184c-4164-b881-06585fe0ff9d service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:57.112284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.120986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:57.121676 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.121970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.122249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.123557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:57.125561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:57.194133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33532a1f-2f2f-4855-954f-65d9bd8eff62 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:57.199410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 878/1746] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:57 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:57.200520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:57.203335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.282859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c69e66-55b7-4658-afba-1cc43d7b2701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:57.285303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c69e66-55b7-4658-afba-1cc43d7b2701 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.285747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c69e66-55b7-4658-afba-1cc43d7b2701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.286274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c69e66-55b7-4658-afba-1cc43d7b2701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.288398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-39c69e66-55b7-4658-afba-1cc43d7b2701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.311425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8622-ef59-4687-a127-bd8fc3a7105f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:57.317005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:57.317657 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.317943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.318221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] PATH_INFO: `/v3/users/5f7d9e8cfc604990b25c0b1c28a13d77` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.319448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7d9e8cfc604990b25c0b1c28a13d77)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:57.321751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:57.328805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:57.374416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c69e66-55b7-4658-afba-1cc43d7b2701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:57.375899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c69e66-55b7-4658-afba-1cc43d7b2701 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:57.394134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 869/1747] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:57.395548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8da1-db0c-4f74-aa00-b47f235cf78a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.395903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8da1-db0c-4f74-aa00-b47f235cf78a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.396186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8da1-db0c-4f74-aa00-b47f235cf78a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.397720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 870/1748] 10.222.0.52 () {54 vars in 912 bytes} [Sun Sep 25 04:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:35:57.398657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d8da1-db0c-4f74-aa00-b47f235cf78a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:57.412677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d8da1-db0c-4f74-aa00-b47f235cf78a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:57.415180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7d9e8cfc604990b25c0b1c28a13d77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:57.417378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:57.418104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.418268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.418588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.419402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:57.419891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:57.421548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:57.432831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7d9e8cfc604990b25c0b1c28a13d77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:57.433652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7d9e8cfc604990b25c0b1c28a13d77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:57.435050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7d9e8cfc604990b25c0b1c28a13d77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:57.445685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 871/1749] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:57.449185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:57.450019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7d9e8cfc604990b25c0b1c28a13d77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:57.455180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.499696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 879/1750] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:35:57 2022] DELETE /identity/v3/users/5f7d9e8cfc604990b25c0b1c28a13d77 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:57.499696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:57.509720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.532973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:57.591322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac0210-72cb-4d75-8a06-60290779a059 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:57.665031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cda052-331b-471b-9cce-216c59a911c6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:57.671790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:57.672570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.672930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.673279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.674118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:57.677317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:57.740037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 880/1751] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:57 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:57.741256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:57.747942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7a5b0-0853-4f8b-898a-29e5ed0ca760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:57.748741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7a5b0-0853-4f8b-898a-29e5ed0ca760 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.749085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7a5b0-0853-4f8b-898a-29e5ed0ca760 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.749454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7a5b0-0853-4f8b-898a-29e5ed0ca760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.753781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.754178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ee7a5b0-0853-4f8b-898a-29e5ed0ca760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.901034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7a5b0-0853-4f8b-898a-29e5ed0ca760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:57.902953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7a5b0-0853-4f8b-898a-29e5ed0ca760 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:57.915082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07bb14-3973-42c4-9fdc-e33f87fc7ff9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:57.916319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 872/1752] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:57.917751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f3a2-5101-4ad3-83d0-7655b4c1627e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.918041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f3a2-5101-4ad3-83d0-7655b4c1627e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.918311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f3a2-5101-4ad3-83d0-7655b4c1627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.925977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:57.927554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:57.930225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:57.930906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:57.934604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:57.995790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:58.003598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-edf2f3a2-5101-4ad3-83d0-7655b4c1627e None None] MFA Rules not processed for user `d4f75c3e044d4b0dbad6b16ea0599bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:58.008575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-edf2f3a2-5101-4ad3-83d0-7655b4c1627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.056078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:58.060195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:58.120875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 881/1753] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:58.121804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:58.124624 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.163335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b001c7-d069-402d-a7ca-09e6d1dd53f8 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:58.184245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:58.185035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.186035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.186035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:58.187266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:58.189296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:58.199858 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 873/1754] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:35:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:58.201126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f3a2-5101-4ad3-83d0-7655b4c1627e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:58.224819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f3a2-5101-4ad3-83d0-7655b4c1627e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:58.231202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:58.233475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.233896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.234267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:58.235195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:58.237388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:58.253475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 874/1755] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:58.257902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:58.258717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.272251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:58.280610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab4554-5e7c-4afc-88dc-8d27d65c061b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:58.292111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 882/1756] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:58 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:58.294523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:58.299490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:58.300617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.301108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.301592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] PATH_INFO: `/v3/projects/6a8005aa1f4348b097a8ae55f6d0396e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:58.302314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.303448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8005aa1f4348b097a8ae55f6d0396e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:58.305978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:58.452030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8005aa1f4348b097a8ae55f6d0396e', 'request_id': 'req-4c0d70a7-b810-4e7f-9456-a17da2e6324a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.476011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8005aa1f4348b097a8ae55f6d0396e', 'request_id': 'req-4c0d70a7-b810-4e7f-9456-a17da2e6324a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.502433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8005aa1f4348b097a8ae55f6d0396e', 'request_id': 'req-4c0d70a7-b810-4e7f-9456-a17da2e6324a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.524831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da880d-f42c-4304-b02c-c9f6d3d5af8f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:58.538276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] The token cache is being invalidate because project 6a8005aa1f4348b097a8ae55f6d0396e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:58.538867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.540277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.550237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 875/1757] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:58 2022] DELETE /identity/v3/projects/6a8005aa1f4348b097a8ae55f6d0396e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:58.551297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:58.555323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.686215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d70a7-b810-4e7f-9456-a17da2e6324a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:58.692485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:58.693553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:58.694580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.695109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.695331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.695896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] PATH_INFO: `/v3/projects/62148b5f065d4858bae413d96126de93` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:58.696683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.696983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:58.698149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62148b5f065d4858bae413d96126de93)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:58.700543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:58.702839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.719441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:58.720948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:58.749456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 876/1758] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:35:58.750594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:58.755652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.792476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1865c-b968-4635-bb7d-e64a21959cd1 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:58.814340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62148b5f065d4858bae413d96126de93', 'request_id': 'req-691b87b9-0ccd-4453-b521-082fd270fea0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.844666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62148b5f065d4858bae413d96126de93', 'request_id': 'req-691b87b9-0ccd-4453-b521-082fd270fea0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.855254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:58.880756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62148b5f065d4858bae413d96126de93', 'request_id': 'req-691b87b9-0ccd-4453-b521-082fd270fea0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.895976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] The token cache is being invalidate because project 62148b5f065d4858bae413d96126de93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:35:58.896663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.897615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:35:58.900237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 883/1759] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:35:58 2022] DELETE /identity/v3/projects/62148b5f065d4858bae413d96126de93 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:58.901307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:58.904522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.933231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c117fd-2ca4-46f3-96c8-c776ed0823aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:58.933880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c117fd-2ca4-46f3-96c8-c776ed0823aa admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.934172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c117fd-2ca4-46f3-96c8-c776ed0823aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.934467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c117fd-2ca4-46f3-96c8-c776ed0823aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:58.935142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c117fd-2ca4-46f3-96c8-c776ed0823aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:58.936744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c117fd-2ca4-46f3-96c8-c776ed0823aa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:58.951701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 877/1760] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:58.952780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158decea-5a33-4afa-9c0e-8e804a6f0150 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.953070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158decea-5a33-4afa-9c0e-8e804a6f0150 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.953346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158decea-5a33-4afa-9c0e-8e804a6f0150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:58.977917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-158decea-5a33-4afa-9c0e-8e804a6f0150 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:58.979202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-158decea-5a33-4afa-9c0e-8e804a6f0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:58.988094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 878/1761] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:58.989380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:58.989665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:58.989940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.011310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:59.012553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:59.023614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 879/1762] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:59.025162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.027255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:59.045531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76762f-852f-4f52-943b-9ff35edaadc1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.052282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9be78-2bdf-4f2d-863d-534ebb1549d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.053238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9be78-2bdf-4f2d-863d-534ebb1549d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.053907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9be78-2bdf-4f2d-863d-534ebb1549d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.054487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9be78-2bdf-4f2d-863d-534ebb1549d8 admin admin] PATH_INFO: `/v3/projects/672eb936b1fe4bcbbda46d5c04923052/users/7307dde5dd494e419466cb475f8dac66/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.064258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b87b9-0ccd-4453-b521-082fd270fea0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.066261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:59.070613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35de4-b812-4829-ab55-fac8d260236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.071807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35de4-b812-4829-ab55-fac8d260236f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.072708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35de4-b812-4829-ab55-fac8d260236f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.073153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35de4-b812-4829-ab55-fac8d260236f admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.074429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35de4-b812-4829-ab55-fac8d260236f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.076912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35de4-b812-4829-ab55-fac8d260236f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.077065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9be78-2bdf-4f2d-863d-534ebb1549d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672eb936b1fe4bcbbda46d5c04923052, user_id=7307dde5dd494e419466cb475f8dac66, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.084389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9be78-2bdf-4f2d-863d-534ebb1549d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.106292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 880/1763] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:59 2022] PUT /identity/v3/projects/672eb936b1fe4bcbbda46d5c04923052/users/7307dde5dd494e419466cb475f8dac66/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:59.108288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5db61-a77b-4e5f-8656-e308e3ca4e96 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.109067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5db61-a77b-4e5f-8656-e308e3ca4e96 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.109582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5db61-a77b-4e5f-8656-e308e3ca4e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.119563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 884/1764] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:58 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:59.121356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c777e-5e4b-4161-b4db-9d740f4027c5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.121880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c777e-5e4b-4161-b4db-9d740f4027c5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.123562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c777e-5e4b-4161-b4db-9d740f4027c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.151838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-85c5db61-a77b-4e5f-8656-e308e3ca4e96 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:59.153177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-85c5db61-a77b-4e5f-8656-e308e3ca4e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:59.155819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fc7c777e-5e4b-4161-b4db-9d740f4027c5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:59.158644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fc7c777e-5e4b-4161-b4db-9d740f4027c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:59.241342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 881/1765] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:59.241342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2745b6-2a1e-48d9-b1b6-7d297ddef5d4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.241342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2745b6-2a1e-48d9-b1b6-7d297ddef5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.241342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2745b6-2a1e-48d9-b1b6-7d297ddef5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.247189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 885/1766] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:59.248469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c777e-5e4b-4161-b4db-9d740f4027c5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.260324 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c777e-5e4b-4161-b4db-9d740f4027c5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.270591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb873cbb-4d84-4a80-9e08-283c914906b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.271484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb873cbb-4d84-4a80-9e08-283c914906b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.271974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb873cbb-4d84-4a80-9e08-283c914906b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.272614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb873cbb-4d84-4a80-9e08-283c914906b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.273472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb873cbb-4d84-4a80-9e08-283c914906b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.275729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb873cbb-4d84-4a80-9e08-283c914906b6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.277312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bf2745b6-2a1e-48d9-b1b6-7d297ddef5d4 None None] MFA Rules not processed for user `7307dde5dd494e419466cb475f8dac66`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:59.279988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bf2745b6-2a1e-48d9-b1b6-7d297ddef5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:59.288657 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 886/1767] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:59.290265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdcd66-a1ba-48c8-9775-00779ad63a4d None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.290795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdcd66-a1ba-48c8-9775-00779ad63a4d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.291274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdcd66-a1ba-48c8-9775-00779ad63a4d None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.293186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 887/1768] 10.222.0.52 () {54 vars in 912 bytes} [Sun Sep 25 04:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:35:59.294244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdcd66-a1ba-48c8-9775-00779ad63a4d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.309899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdcd66-a1ba-48c8-9775-00779ad63a4d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.316597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.317727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.318273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.318950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.320169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:59.320857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.323405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.345727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 888/1769] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:59.348563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.360256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d7849-7326-436d-ae0c-d7022c4af577 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.366953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.367830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.368360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.368841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.369696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:35:59.370216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.372122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.394521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 889/1770] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:35:59.395652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.402474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 882/1771] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:59.404437 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bbf5-b526-4b6b-8cc2-a6ffcf1573ff None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.404902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bbf5-b526-4b6b-8cc2-a6ffcf1573ff None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.405353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bbf5-b526-4b6b-8cc2-a6ffcf1573ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.407345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa270-9c4d-447f-a48f-4f7e74b57e2e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.413271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.413894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.414177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.414497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.415156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.417069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.429646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 890/1772] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:35:59.430630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.433845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d059bbf5-b526-4b6b-8cc2-a6ffcf1573ff None None] MFA Rules not processed for user `d4f75c3e044d4b0dbad6b16ea0599bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:35:59.437357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d059bbf5-b526-4b6b-8cc2-a6ffcf1573ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:59.443887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e114182-fd21-47e3-b5fa-0c22d6bd7298 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.466474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.467994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.468288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.468568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.469234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.472226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.529526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 891/1773] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:59.530619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.538756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:59.554780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 883/1774] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:35:59.555933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059bbf5-b526-4b6b-8cc2-a6ffcf1573ff None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.596472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059bbf5-b526-4b6b-8cc2-a6ffcf1573ff None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.666892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:59.712087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43e77-38a6-4af7-84a2-f0fdb23c2d71 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.721041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.722402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.723999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.724615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.726004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.726757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.728414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.728671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.729133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.729655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.730688 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.734143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.778255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 884/1775] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:59.779281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.790524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 892/1776] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:35:59.790524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:35:59.790524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:35:59.877527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb95f0-552d-4667-af35-3cb09dc18cbd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.890100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:35:59.891651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:35:59.891935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:35:59.892239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] PATH_INFO: `/v3/projects/1e3ef11b9d324d3d99a89d9822cdce17/users/033b31b21e884ca1b333acf548174f34/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:35:59.925262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022f581-d317-40d2-9395-49bdbc269ca5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:35:59.935024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3ef11b9d324d3d99a89d9822cdce17, user_id=033b31b21e884ca1b333acf548174f34, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:35:59.938098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:35:59.968756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 885/1777] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:35:59 2022] PUT /identity/v3/projects/1e3ef11b9d324d3d99a89d9822cdce17/users/033b31b21e884ca1b333acf548174f34/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:35:59.970653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.057530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f661b-e167-49e2-8442-294549285b74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.058270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f661b-e167-49e2-8442-294549285b74 service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.058712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f661b-e167-49e2-8442-294549285b74 service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.059015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f661b-e167-49e2-8442-294549285b74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.061142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0b1f661b-e167-49e2-8442-294549285b74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:00.086901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f661b-e167-49e2-8442-294549285b74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.088928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f661b-e167-49e2-8442-294549285b74 service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.098188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6036d58-c7f0-457e-a205-7bd4d8798dbe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.104047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.104732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.105302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 893/1778] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:35:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:00.106644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.106935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.107420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e16a7-18ac-407d-abd7-ae0657220988 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.107641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.108226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e16a7-18ac-407d-abd7-ae0657220988 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.108684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e16a7-18ac-407d-abd7-ae0657220988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.109736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.137828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-523e16a7-18ac-407d-abd7-ae0657220988 None None] MFA Rules not processed for user `5bdeb69b2259462b90c34aede652f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:00.139383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-523e16a7-18ac-407d-abd7-ae0657220988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:00.142146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 886/1779] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:35:59 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:00.143246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.147975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:00.164058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:00.213704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:00.236099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 894/1780] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:00.238178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e16a7-18ac-407d-abd7-ae0657220988 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.262407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511aa7-e00e-4f7e-827b-822d58465992 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.268812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.269617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.269948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.270295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.281016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.282967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.297338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e16a7-18ac-407d-abd7-ae0657220988 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.311325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593733-697a-4aa5-b373-0825814986c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.311961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593733-697a-4aa5-b373-0825814986c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.312358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593733-697a-4aa5-b373-0825814986c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.312632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593733-697a-4aa5-b373-0825814986c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.313287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593733-697a-4aa5-b373-0825814986c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.317451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 887/1781] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:00.318442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593733-697a-4aa5-b373-0825814986c9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.318551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.347492 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149667c-06a0-4929-acc8-d2db7d23b4d8 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.353832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.354570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.355027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.355360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.356555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.359005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.370971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 895/1782] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:00 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:00.372485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360c5a-243d-46dd-a9c8-3a1fbb354b3f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.372774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360c5a-243d-46dd-a9c8-3a1fbb354b3f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.373572 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360c5a-243d-46dd-a9c8-3a1fbb354b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.406586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 888/1783] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:00 2022] POST /identity/v3/users => generated 289 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:00.406586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.421634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d753-3f53-4b23-b3a2-d187555ce4b0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.429239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.430139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.430739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.431119 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.431966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.435539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.479171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 889/1784] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:00.480906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.483739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8a360c5a-243d-46dd-a9c8-3a1fbb354b3f None None] MFA Rules not processed for user `033b31b21e884ca1b333acf548174f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:00.489890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8a360c5a-243d-46dd-a9c8-3a1fbb354b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:00.506806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763a28-da78-42d3-9f45-506735276459 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.517176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.519414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.519792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.520910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.521672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.526654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.554763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 890/1785] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:00.556063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.601234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eef05b-0ca6-4778-aa2c-6b932dc90c64 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.616720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.617369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.617653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.617937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.623606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.625020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.652297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 891/1786] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:00.657646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.680990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e1f8-8703-4766-8de5-7fdd1662ab4d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.689778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 896/1787] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:00.691533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.692217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.692500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.692826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.693305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a360c5a-243d-46dd-a9c8-3a1fbb354b3f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.693478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.695315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.713381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 892/1788] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:00.714677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.723763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a360c5a-243d-46dd-a9c8-3a1fbb354b3f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.731674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.737977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.738313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.738866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] PATH_INFO: `/v3/projects/31c800edc7c0483b85fa9f24b34159ad/users/31baab2dd904410cba8d475eb9c6c59c/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.739010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f87e-d741-4e56-8da1-b3b06f245bb0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.745702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.746440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.746806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.747084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.747743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.749360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.775244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c800edc7c0483b85fa9f24b34159ad, user_id=31baab2dd904410cba8d475eb9c6c59c, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.777005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 893/1789] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:00.778034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.778859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.804241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b822a0-52f4-4057-bbca-1a56f991c632 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.809952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 897/1790] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:00 2022] PUT /identity/v3/projects/31c800edc7c0483b85fa9f24b34159ad/users/31baab2dd904410cba8d475eb9c6c59c/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:00.810858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:00.913101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.917130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.917351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.917625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.918604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:00.922765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:00.944157 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9619-7046-4115-ba25-c1d5ae41a000 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:00.952805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:00.964164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:00.964500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:00.964898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] PATH_INFO: `/v3/projects/3ceea36371ce45ecaabdfc515bd83b92/users/6bba619a976b48aab4a3d77ed68f7d2a/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:00.984305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 894/1791] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:00 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:00.985605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:01.020111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ceea36371ce45ecaabdfc515bd83b92, user_id=6bba619a976b48aab4a3d77ed68f7d2a, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:01.029075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:01.044969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:01.083988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 898/1792] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:00 2022] PUT /identity/v3/projects/3ceea36371ce45ecaabdfc515bd83b92/users/6bba619a976b48aab4a3d77ed68f7d2a/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:01.087729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:01.171679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:01.223163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c826e-66f6-4f48-a46d-31ad3d50070f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:01.334091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f6dc-3d63-40fa-9cdc-520f09680d28 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:01.350403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:01.351411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:01.353097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:01.353800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:01.354920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:01.357365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:01.383412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 899/1793] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:01.386558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:01.411291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85117676-fdb8-4c41-9a0f-f20370d593f3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:01.427748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534c982-171f-4c5f-849e-efa4c9e3d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:01.428543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534c982-171f-4c5f-849e-efa4c9e3d035 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:01.428961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534c982-171f-4c5f-849e-efa4c9e3d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:01.431072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534c982-171f-4c5f-849e-efa4c9e3d035 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:01.431831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534c982-171f-4c5f-849e-efa4c9e3d035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:01.434115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534c982-171f-4c5f-849e-efa4c9e3d035 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:01.469561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:01.470916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:01.471198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:01.473407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] PATH_INFO: `/v3/projects/63cdbd29719a4b7c998a3a6af7e6995a/users/9bcb207fe32649699cc5567590654e40/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:01.521831 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cdbd29719a4b7c998a3a6af7e6995a, user_id=9bcb207fe32649699cc5567590654e40, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:01.525349 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:01.540658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 900/1794] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:01 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:01.542291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfc92-7ea4-42ed-bc2f-da78df59cf3f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:01.542682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfc92-7ea4-42ed-bc2f-da78df59cf3f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:01.542991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfc92-7ea4-42ed-bc2f-da78df59cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:01.559302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 895/1795] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:00 2022] PUT /identity/v3/projects/63cdbd29719a4b7c998a3a6af7e6995a/users/9bcb207fe32649699cc5567590654e40/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:01.560894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:01.632864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2b3bfc92-7ea4-42ed-bc2f-da78df59cf3f None None] MFA Rules not processed for user `6bba619a976b48aab4a3d77ed68f7d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:01.636358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2b3bfc92-7ea4-42ed-bc2f-da78df59cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:01.772491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dea267-39e7-4013-a584-bbe4d8feaca9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:01.778622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:01.779352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:01.779645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:01.779926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] PATH_INFO: `/v3/projects/31c800edc7c0483b85fa9f24b34159ad/users/31baab2dd904410cba8d475eb9c6c59c/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:01.782038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c800edc7c0483b85fa9f24b34159ad, user_id=31baab2dd904410cba8d475eb9c6c59c, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:01.785759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:01.802206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 896/1796] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:01 2022] PUT /identity/v3/projects/31c800edc7c0483b85fa9f24b34159ad/users/31baab2dd904410cba8d475eb9c6c59c/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:01.810556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:01.858390 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 901/1797] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:01.863578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd1c5-799e-48f3-92e6-3e97331ad2bc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:01.863883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd1c5-799e-48f3-92e6-3e97331ad2bc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:01.864185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd1c5-799e-48f3-92e6-3e97331ad2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:01.959708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-05abd1c5-799e-48f3-92e6-3e97331ad2bc None None] MFA Rules not processed for user `9bcb207fe32649699cc5567590654e40`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:01.961249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-05abd1c5-799e-48f3-92e6-3e97331ad2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:02.012504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf8b1-a9fe-4137-bee9-63733567c23e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.022539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447c39c-20df-4c73-917c-8417c2e24d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.023556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c39c-20df-4c73-917c-8417c2e24d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.023763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c39c-20df-4c73-917c-8417c2e24d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.024045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c39c-20df-4c73-917c-8417c2e24d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.024713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447c39c-20df-4c73-917c-8417c2e24d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.031813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447c39c-20df-4c73-917c-8417c2e24d94 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.045185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:02.061143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 897/1798] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:02.068189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.068427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.069881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.110071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:02.120414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] MFA Rules not processed for user `31baab2dd904410cba8d475eb9c6c59c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:02.121723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:02.140636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 902/1799] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:02.141869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd1c5-799e-48f3-92e6-3e97331ad2bc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.176933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd1c5-799e-48f3-92e6-3e97331ad2bc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.184266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.185271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.185971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.186359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.187177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.193341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.252446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 903/1800] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:02 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:02.265043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.329499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 898/1801] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:02.331965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.335026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:02.432696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb33c-730c-49a4-a088-86dca6dcf64c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.448534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.449295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.449590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.449860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] PATH_INFO: `/v3/projects/8a735418e8e2436fae81412677c91c13/users/058c02b33ddc4c46ab1790023e4cbb49/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.480752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a735418e8e2436fae81412677c91c13, user_id=058c02b33ddc4c46ab1790023e4cbb49, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.484600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.520420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 904/1802] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:02 2022] PUT /identity/v3/projects/8a735418e8e2436fae81412677c91c13/users/058c02b33ddc4c46ab1790023e4cbb49/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:02.524607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.542493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd2be5-0b33-4808-ac9d-9a0cf45b32d7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.639578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf37ab-29b4-4cf2-b44b-70c6c7f34a10 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.645928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.646271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.646608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.646888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.648024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.650915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.677148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 905/1803] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:02 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:02.681279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.682971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:02.688534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.689156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.689957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.690373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.752225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:02.766378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33853a17-bfdf-427e-b012-43bbe8a43c75 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.767951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:02.772211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.773244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.773564 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.773924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.815523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.818005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.833124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 899/1804] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:02.834001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.868111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26759ba-a13f-4319-b604-96f3f9167320 service glance] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.871694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.873243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.875248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.876214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.876966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.877429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.878908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.883241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.885113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 906/1805] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:02.886233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.887783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:02.902674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 900/1806] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:02.903867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.904547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d563bb-bf72-4ef9-b27b-976d66e64a9e service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.911172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.912319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.912910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.913470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] PATH_INFO: `/v3/users/8f2c1a0a6e6947f3962a559edc5d713c` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.915147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2c1a0a6e6947f3962a559edc5d713c)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.917298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.917519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cce083-73c6-413b-8513-c9ab7c3ffa49 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.926015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.927064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.927064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.928189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.928857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.930488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.943320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 901/1807] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:02.944347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:02.965298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c1b93-ce08-45d8-b420-5686921259aa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:02.971642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:02.972364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:02.972649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:02.972934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] PATH_INFO: `/v3/projects/8a735418e8e2436fae81412677c91c13/users/058c02b33ddc4c46ab1790023e4cbb49/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:02.975959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a735418e8e2436fae81412677c91c13, user_id=058c02b33ddc4c46ab1790023e4cbb49, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:02.979576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:02.995231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 902/1808] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:02 2022] PUT /identity/v3/projects/8a735418e8e2436fae81412677c91c13/users/058c02b33ddc4c46ab1790023e4cbb49/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:02.996116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:03.090485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2c1a0a6e6947f3962a559edc5d713c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:03.106141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40442-504b-4b81-9ac9-e4ad61fd3c93 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:03.112561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2c1a0a6e6947f3962a559edc5d713c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:03.114697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2c1a0a6e6947f3962a559edc5d713c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:03.115753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2c1a0a6e6947f3962a559edc5d713c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:03.120564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b1229-22ed-4916-a86c-f503df6f611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:03.121401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1229-22ed-4916-a86c-f503df6f611c admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.121746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1229-22ed-4916-a86c-f503df6f611c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.121966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1229-22ed-4916-a86c-f503df6f611c admin admin] PATH_INFO: `/v3/projects/1744722d2060439f8a362a611f0c0518/users/95e0c66c31584840a5b7319c61a24fda/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:03.156879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2c1a0a6e6947f3962a559edc5d713c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:03.158216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b1229-22ed-4916-a86c-f503df6f611c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1744722d2060439f8a362a611f0c0518, user_id=95e0c66c31584840a5b7319c61a24fda, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:03.161756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b1229-22ed-4916-a86c-f503df6f611c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:03.193221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 903/1809] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:02 2022] PUT /identity/v3/projects/1744722d2060439f8a362a611f0c0518/users/95e0c66c31584840a5b7319c61a24fda/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:03.194761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e506-63ff-409c-8743-48f042168771 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.195024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e506-63ff-409c-8743-48f042168771 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.195300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e506-63ff-409c-8743-48f042168771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:03.202692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 907/1810] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:02 2022] DELETE /identity/v3/users/8f2c1a0a6e6947f3962a559edc5d713c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:03.204122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:03.207424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:03.262226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1962e506-63ff-409c-8743-48f042168771 None None] MFA Rules not processed for user `058c02b33ddc4c46ab1790023e4cbb49`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:03.264104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1962e506-63ff-409c-8743-48f042168771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:03.349677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2fc8-3e01-442a-87cb-b3ec80ebee84 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:03.378470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ec542-0a4c-407c-9097-66a64216e546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:03.378470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec542-0a4c-407c-9097-66a64216e546 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.378470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec542-0a4c-407c-9097-66a64216e546 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.378470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec542-0a4c-407c-9097-66a64216e546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:03.380299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c43ec542-0a4c-407c-9097-66a64216e546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:03.417894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:03.433357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 904/1811] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:03.434418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e506-63ff-409c-8743-48f042168771 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:03.435880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1962e506-63ff-409c-8743-48f042168771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:03.448720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:03.496294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ec542-0a4c-407c-9097-66a64216e546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:03.503948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ec542-0a4c-407c-9097-66a64216e546 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:03.531277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 908/1812] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:03.532730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.533023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.533301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:03.552259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e506-63ff-409c-8743-48f042168771 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:03.557672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:03.558588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.558902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.559319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:03.561274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:03.563106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:03.572211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:03.576076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:03.600248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 909/1813] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:03.611469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:03.613559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:03.630560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 905/1814] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:03.637161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:03.668031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b034e-9e17-482b-ad38-8cfd4a2ecc36 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:03.681125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:03.681849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.682133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.682440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] PATH_INFO: `/v3/projects/1744722d2060439f8a362a611f0c0518/users/95e0c66c31584840a5b7319c61a24fda/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:03.687416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1744722d2060439f8a362a611f0c0518, user_id=95e0c66c31584840a5b7319c61a24fda, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:03.695098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:03.742690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f1199-9ea7-4c61-9711-3af9dcd2dc04 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:03.742936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 906/1815] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:03 2022] PUT /identity/v3/projects/1744722d2060439f8a362a611f0c0518/users/95e0c66c31584840a5b7319c61a24fda/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:03.744465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:03.746827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:03.896435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af3059-def6-4485-a767-03a4d0874acd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:03.905393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de357c02-9cbf-40a7-8c1f-618499d81332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:03.907311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357c02-9cbf-40a7-8c1f-618499d81332 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.910031 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357c02-9cbf-40a7-8c1f-618499d81332 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.910473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357c02-9cbf-40a7-8c1f-618499d81332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:03.949679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13624f2-2dc4-48ce-bb5d-5dea97e1adc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:03.954136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13624f2-2dc4-48ce-bb5d-5dea97e1adc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:03.954456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13624f2-2dc4-48ce-bb5d-5dea97e1adc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:03.954735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13624f2-2dc4-48ce-bb5d-5dea97e1adc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:04.130502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de357c02-9cbf-40a7-8c1f-618499d81332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:04.132220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de357c02-9cbf-40a7-8c1f-618499d81332 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:04.164173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 907/1816] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:04.166123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:04.166584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:04.166996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:04.181255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13624f2-2dc4-48ce-bb5d-5dea97e1adc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:04.188659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13624f2-2dc4-48ce-bb5d-5dea97e1adc1 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:04.209614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 910/1817] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:04.211186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029bc3-1f98-429b-a12f-f3968b7608fd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:04.211504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029bc3-1f98-429b-a12f-f3968b7608fd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:04.211784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029bc3-1f98-429b-a12f-f3968b7608fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:04.309594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:04.321789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] MFA Rules not processed for user `95e0c66c31584840a5b7319c61a24fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:04.323086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:04.344432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-87029bc3-1f98-429b-a12f-f3968b7608fd None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:04.345857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-87029bc3-1f98-429b-a12f-f3968b7608fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:04.390741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:04.456439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 911/1818] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:36:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:04.457827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6f03-3932-4280-98aa-e78351b46d9b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:04.458218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6f03-3932-4280-98aa-e78351b46d9b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:04.458627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6f03-3932-4280-98aa-e78351b46d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:04.497305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 908/1819] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:04.498334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:04.500462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:04.513913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7a0b6f03-3932-4280-98aa-e78351b46d9b None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:04.515630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7a0b6f03-3932-4280-98aa-e78351b46d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:04.524866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 912/1820] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:36:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:04.525900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6f03-3932-4280-98aa-e78351b46d9b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:04.545593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841747-24b3-45e1-9d5f-38febc216af1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:04.549670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6f03-3932-4280-98aa-e78351b46d9b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:04.555603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:04.556470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:04.556757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:04.557035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:04.558298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:04.561416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:04.561911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:04.564366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] PATH_INFO: `/v3/users/033b31b21e884ca1b333acf548174f34` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:04.568138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=033b31b21e884ca1b333acf548174f34)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:04.569899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:04.572174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:04.572483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:04.587308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 913/1821] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:04.650211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033b31b21e884ca1b333acf548174f34'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:04.651198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033b31b21e884ca1b333acf548174f34'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:04.659897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:04.662806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:04.687824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033b31b21e884ca1b333acf548174f34'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:04.716883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033b31b21e884ca1b333acf548174f34'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:04.762902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033b31b21e884ca1b333acf548174f34'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:04.789892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 909/1822] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:04 2022] DELETE /identity/v3/users/033b31b21e884ca1b333acf548174f34 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:04.791036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:04.793845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:04.913231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a043cbc-c565-4754-8bfe-ebdbaab12dd4 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:04.948966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e6a83-0f74-486a-9ad9-a38f6398b0b5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:04.956641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:04.957557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:04.958328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:04.958745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:04.961355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:05.002616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:05.038445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae850129-add8-4e1d-9d46-c39c2f8a285d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:05.039089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae850129-add8-4e1d-9d46-c39c2f8a285d service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:05.039369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae850129-add8-4e1d-9d46-c39c2f8a285d service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:05.039647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae850129-add8-4e1d-9d46-c39c2f8a285d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:05.044671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ae850129-add8-4e1d-9d46-c39c2f8a285d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:05.084401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:05.144915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:05.146932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:05.166965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 910/1823] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:36:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:36:05.169661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:05.173472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:05.276709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae850129-add8-4e1d-9d46-c39c2f8a285d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:05.278265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae850129-add8-4e1d-9d46-c39c2f8a285d service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:05.294107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 914/1824] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:36:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:36:05.295927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:05.296252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:05.296666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:05.348173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e869d5-7642-48b2-b751-6d2953c8e3fd service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:05.358764 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:05.360274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac90a6-3786-4ddd-b648-b90b3b0ea145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:05.361024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac90a6-3786-4ddd-b648-b90b3b0ea145 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:05.362821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac90a6-3786-4ddd-b648-b90b3b0ea145 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:05.365488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:05.370709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac90a6-3786-4ddd-b648-b90b3b0ea145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:05.375311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-73ac90a6-3786-4ddd-b648-b90b3b0ea145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:05.572709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 915/1825] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:05.697358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:05.699367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:05.777365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac90a6-3786-4ddd-b648-b90b3b0ea145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:05.787101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac90a6-3786-4ddd-b648-b90b3b0ea145 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:05.826001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 911/1826] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:05.827467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851d0ab-63ed-4072-9533-1d004030f92b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:05.827762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851d0ab-63ed-4072-9533-1d004030f92b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:05.828046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851d0ab-63ed-4072-9533-1d004030f92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:05.921770 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2851d0ab-63ed-4072-9533-1d004030f92b None None] MFA Rules not processed for user `d4f75c3e044d4b0dbad6b16ea0599bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:05.922726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6621c67-c1ad-4513-bc18-fce9f82036f7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:05.923105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2851d0ab-63ed-4072-9533-1d004030f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:05.935983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:05.937192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:05.937818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:05.938486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:05.957933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 912/1827] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 25 04:36:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:05.967436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:05.971692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:05.991418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 916/1828] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:05.991781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851d0ab-63ed-4072-9533-1d004030f92b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:06.014987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851d0ab-63ed-4072-9533-1d004030f92b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:06.035334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:06.035976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:06.036264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:06.036552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:06.059752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:06.062529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:06.063848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:06.065364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:06.103101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 913/1829] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:06.135469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364a2f-d58d-457c-824c-2a4faa3394ba service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:06.195369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:06.196283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:06.197534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:06.199189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] PATH_INFO: `/v3/projects/f8c4669ff3474917b975f59dfc9dd49b` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:06.202070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c4669ff3474917b975f59dfc9dd49b)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:06.204322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:06.412949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:06.462028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c4669ff3474917b975f59dfc9dd49b', 'request_id': 'req-d7575555-ac34-4735-bb62-299ee4e8c899'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.472407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c4669ff3474917b975f59dfc9dd49b', 'request_id': 'req-d7575555-ac34-4735-bb62-299ee4e8c899'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.489715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c4669ff3474917b975f59dfc9dd49b', 'request_id': 'req-d7575555-ac34-4735-bb62-299ee4e8c899'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.514606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] The token cache is being invalidate because project f8c4669ff3474917b975f59dfc9dd49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:06.514908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.516635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.518787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 917/1830] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:06 2022] DELETE /identity/v3/projects/f8c4669ff3474917b975f59dfc9dd49b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:06.522917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:06.545524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116a5e-7917-48e3-aa26-f4f0c5778364 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:06.686990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:06.688533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:06.690123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:06.690437 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] PATH_INFO: `/v3/users/6836dfc4a3884acda7248849d53234d7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:06.697508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6836dfc4a3884acda7248849d53234d7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:06.699792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:06.742305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:06.825481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6836dfc4a3884acda7248849d53234d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.826535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6836dfc4a3884acda7248849d53234d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.837780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6836dfc4a3884acda7248849d53234d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.855021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6836dfc4a3884acda7248849d53234d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.890621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6836dfc4a3884acda7248849d53234d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:06.906583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 914/1831] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:06 2022] DELETE /identity/v3/users/6836dfc4a3884acda7248849d53234d7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:08.092280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:08.095691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:08.144767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7575555-ac34-4735-bb62-299ee4e8c899 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:08.422491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:08.423164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:08.429183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:08.430668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] PATH_INFO: `/v3/projects/1e3ef11b9d324d3d99a89d9822cdce17` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:08.441711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3ef11b9d324d3d99a89d9822cdce17)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:08.443742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:08.572159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:08.573794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:08.601132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5151-b52e-4997-b220-d53f82dfe094 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:08.663825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3ef11b9d324d3d99a89d9822cdce17', 'request_id': 'req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:08.697762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3ef11b9d324d3d99a89d9822cdce17', 'request_id': 'req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:08.721881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3ef11b9d324d3d99a89d9822cdce17', 'request_id': 'req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:08.774894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] The token cache is being invalidate because project 1e3ef11b9d324d3d99a89d9822cdce17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:08.775112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:08.779145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:08.793576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 918/1832] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:08 2022] DELETE /identity/v3/projects/1e3ef11b9d324d3d99a89d9822cdce17 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:08.794767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:08.797844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:08.877626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:08.878178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:08.878483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:08.878763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] PATH_INFO: `/v3/projects/c24728a76d3d4d178405484915cbc6bd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:08.881935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24728a76d3d4d178405484915cbc6bd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:08.883937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:08.969635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:09.002913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24728a76d3d4d178405484915cbc6bd', 'request_id': 'req-d9a797de-694e-4be3-bf86-6ab897949b1c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.005757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a36e7-bf16-49cf-992b-f8fbdf7214d2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:09.028455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24728a76d3d4d178405484915cbc6bd', 'request_id': 'req-d9a797de-694e-4be3-bf86-6ab897949b1c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.048462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24728a76d3d4d178405484915cbc6bd', 'request_id': 'req-d9a797de-694e-4be3-bf86-6ab897949b1c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.104725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] The token cache is being invalidate because project c24728a76d3d4d178405484915cbc6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:09.105097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.106020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9a797de-694e-4be3-bf86-6ab897949b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.111683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 915/1833] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:08 2022] DELETE /identity/v3/projects/c24728a76d3d4d178405484915cbc6bd => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:09.113808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7167441-1d20-4284-85b7-73f2a1419f79 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:09.114427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7167441-1d20-4284-85b7-73f2a1419f79 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:09.114533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7167441-1d20-4284-85b7-73f2a1419f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:09.163219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a7167441-1d20-4284-85b7-73f2a1419f79 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:09.170864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a7167441-1d20-4284-85b7-73f2a1419f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:09.224030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:09.233470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:09.234760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:09.235206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:09.235737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] PATH_INFO: `/v3/users/058c02b33ddc4c46ab1790023e4cbb49` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:09.239103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058c02b33ddc4c46ab1790023e4cbb49)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:09.244982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:09.422533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058c02b33ddc4c46ab1790023e4cbb49'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.427620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 916/1834] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:09.439167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482546b3-cd92-4d5f-a52e-45e8304ae6c0 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:09.439485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482546b3-cd92-4d5f-a52e-45e8304ae6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:09.441598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058c02b33ddc4c46ab1790023e4cbb49'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.442235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058c02b33ddc4c46ab1790023e4cbb49'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.443061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058c02b33ddc4c46ab1790023e4cbb49'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.445057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482546b3-cd92-4d5f-a52e-45e8304ae6c0 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:09.456890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 917/1835] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:36:09 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:36:09.459685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2f69-aae7-4a7d-a70a-ff45586580d6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:09.461531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2f69-aae7-4a7d-a70a-ff45586580d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:09.462818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2f69-aae7-4a7d-a70a-ff45586580d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:09.505834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058c02b33ddc4c46ab1790023e4cbb49'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:09.514642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-db4e2f69-aae7-4a7d-a70a-ff45586580d6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:09.517720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-db4e2f69-aae7-4a7d-a70a-ff45586580d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:09.541724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 918/1836] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:09.544918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:09.545336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:09.546457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:09.606126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:09.608117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 919/1837] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:08 2022] DELETE /identity/v3/users/058c02b33ddc4c46ab1790023e4cbb49 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:09.613517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:09.615803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:09.880627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e77e3d-26e9-4d2a-99dd-03d1defb1bd4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:09.904093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:09.906007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:09.906298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:09.906617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:09.913337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:09.913672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:09.922052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:09.926603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 919/1838] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:09.941608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:09.943106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:09.984185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 920/1839] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:09.986164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:10.007900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccda0c-24de-4445-ac84-aaf7008f4a83 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:10.019930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e98df-5ba4-4447-9ea9-46633427f0ab admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:10.031684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:10.032329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.032610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.032883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.043750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:10.044375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.046406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.046726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.047476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:10.049868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:10.062880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:10.065686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:10.090189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:10.108018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 920/1840] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:10.154753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 921/1841] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:09 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:10.159431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:10.182906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd970b-fd8a-4397-b83a-e8281f70d548 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:10.360730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea2053-d375-4cc3-b659-eb2fe23f0a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:10.361415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2053-d375-4cc3-b659-eb2fe23f0a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.361710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2053-d375-4cc3-b659-eb2fe23f0a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.362533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2053-d375-4cc3-b659-eb2fe23f0a11 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.363147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea2053-d375-4cc3-b659-eb2fe23f0a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:10.365113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea2053-d375-4cc3-b659-eb2fe23f0a11 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:10.440488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 921/1842] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:10 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:10.442587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:10.481470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb44e7-b859-4697-a773-8ace32991bc4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:10.494863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d7e4e-0126-4206-a1b9-8329c4326dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:10.495824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d7e4e-0126-4206-a1b9-8329c4326dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.496214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d7e4e-0126-4206-a1b9-8329c4326dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.496490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d7e4e-0126-4206-a1b9-8329c4326dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.497256 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d7e4e-0126-4206-a1b9-8329c4326dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:10.512980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d7e4e-0126-4206-a1b9-8329c4326dfb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:10.521934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e840a92-19b7-4814-a09a-0316e5abd26c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.522475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e840a92-19b7-4814-a09a-0316e5abd26c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.522857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e840a92-19b7-4814-a09a-0316e5abd26c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.524835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 922/1843] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:36:10.545192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 922/1844] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:10.546471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e840a92-19b7-4814-a09a-0316e5abd26c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:10.585800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e840a92-19b7-4814-a09a-0316e5abd26c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:10.593488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.594529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.595074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.613358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:10.620451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.622170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.623791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.625186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:10.632594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:10.663326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 923/1845] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:10.668259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:10.681249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:10.682551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:10.691425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d85bc-0785-49c8-b8fa-eb92a27955da admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:10.705744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfdc25-f4b4-45a9-a9aa-984158c99a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:10.708628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfdc25-f4b4-45a9-a9aa-984158c99a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.710200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfdc25-f4b4-45a9-a9aa-984158c99a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.710736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfdc25-f4b4-45a9-a9aa-984158c99a35 admin admin] PATH_INFO: `/v3/projects/a2a1b7d7b95b400684b7ade211f92ebe/users/48903e1aa4bd4dc3835c42ba4a8f22ed/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.736748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:10.742076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfdc25-f4b4-45a9-a9aa-984158c99a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a1b7d7b95b400684b7ade211f92ebe, user_id=48903e1aa4bd4dc3835c42ba4a8f22ed, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:10.747284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfdc25-f4b4-45a9-a9aa-984158c99a35 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:10.772572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 924/1846] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:10 2022] PUT /identity/v3/projects/a2a1b7d7b95b400684b7ade211f92ebe/users/48903e1aa4bd4dc3835c42ba4a8f22ed/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:10.791843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ff58-d7d4-4aed-9205-8d9d6952ac9e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:10.792783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ff58-d7d4-4aed-9205-8d9d6952ac9e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:10.795565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ff58-d7d4-4aed-9205-8d9d6952ac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:10.849393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 923/1847] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:36:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:10.980965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-57c6ff58-d7d4-4aed-9205-8d9d6952ac9e None None] MFA Rules not processed for user `48903e1aa4bd4dc3835c42ba4a8f22ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:10.985311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-57c6ff58-d7d4-4aed-9205-8d9d6952ac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:11.097618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:11.099474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:11.141423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7cba2-0624-4fd9-a3c7-822bf3864d08 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:11.246283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 925/1848] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:11.251026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ff58-d7d4-4aed-9205-8d9d6952ac9e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:11.411653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:11.413123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:11.413409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:11.413687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:11.448745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:11.452717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:11.484253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 924/1849] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:11.488300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ff58-d7d4-4aed-9205-8d9d6952ac9e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:11.513111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:11.513761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:11.514073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:11.514610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:11.515266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:11.517194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:11.600104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 926/1850] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:11 2022] POST /identity/v3/projects => generated 373 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:11.603909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:11.620027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959cb05-c74c-4c60-b8f9-2ecd953b953b service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:11.750388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:11.767688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:11.768855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:11.769161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:11.769576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:11.770241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:11.775769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:11.820497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 925/1851] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:11 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:11.825864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:11.843892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31eeb-8b49-4cd4-9942-603d608560af admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:11.860530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:11.861094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:11.861452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:11.861670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:11.862454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:11.868658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:11.920164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 927/1852] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:11.925425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:11.942833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109a54-d1bc-46c2-9b41-2905bb4e6cda admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:11.973009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:11.976147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:11.976147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:11.976147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] PATH_INFO: `/v3/projects/f2afd97113884ddebf4896850a3db0a3/users/6e1a5456512c4f1ca12bd2c17aee4094/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:12.049352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2afd97113884ddebf4896850a3db0a3, user_id=6e1a5456512c4f1ca12bd2c17aee4094, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:12.052846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:12.087647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 926/1853] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:11 2022] PUT /identity/v3/projects/f2afd97113884ddebf4896850a3db0a3/users/6e1a5456512c4f1ca12bd2c17aee4094/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:12.094893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:12.154367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7b068-0a7b-4d25-90f9-117be3656dfd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:12.355757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:12.384347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:12.385264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:12.386709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:12.387145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:12.388487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:12.396040 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:12.430294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 928/1854] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:12.435608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:12.447493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:12.451077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:12.459431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139c1c-3083-4fa1-b798-bdfb77ae030d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:12.465916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3d4bb-153b-4b10-93ff-c7d717e4e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:12.468539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3d4bb-153b-4b10-93ff-c7d717e4e98c admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:12.468539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3d4bb-153b-4b10-93ff-c7d717e4e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:12.468539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3d4bb-153b-4b10-93ff-c7d717e4e98c admin admin] PATH_INFO: `/v3/projects/f2afd97113884ddebf4896850a3db0a3/users/6e1a5456512c4f1ca12bd2c17aee4094/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:12.470775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3d4bb-153b-4b10-93ff-c7d717e4e98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2afd97113884ddebf4896850a3db0a3, user_id=6e1a5456512c4f1ca12bd2c17aee4094, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:12.475458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3d4bb-153b-4b10-93ff-c7d717e4e98c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:12.477350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dfe80-394f-4afd-be8b-543720003a82 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:12.498395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:12.499300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:12.499796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:12.500373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] PATH_INFO: `/v3/projects/8a735418e8e2436fae81412677c91c13` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:12.501047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 927/1855] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:12 2022] PUT /identity/v3/projects/f2afd97113884ddebf4896850a3db0a3/users/6e1a5456512c4f1ca12bd2c17aee4094/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:12.503661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a735418e8e2436fae81412677c91c13)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:12.503785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:12.503972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:12.504352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:12.506378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:12.567995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] MFA Rules not processed for user `6e1a5456512c4f1ca12bd2c17aee4094`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:12.572300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:12.632234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a735418e8e2436fae81412677c91c13', 'request_id': 'req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:12.655558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a735418e8e2436fae81412677c91c13', 'request_id': 'req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:12.681928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a735418e8e2436fae81412677c91c13', 'request_id': 'req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:12.729045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] The token cache is being invalidate because project 8a735418e8e2436fae81412677c91c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:12.729348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:12.731487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60f71688-8940-4c2d-94a6-2b13b4a7ba7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:12.738907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 929/1856] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:12 2022] DELETE /identity/v3/projects/8a735418e8e2436fae81412677c91c13 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:12.747223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9ccd-fa32-42f6-b12a-66ea81845a17 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:12.749760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9ccd-fa32-42f6-b12a-66ea81845a17 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:12.751438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9ccd-fa32-42f6-b12a-66ea81845a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:12.792437 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2f8f9ccd-fa32-42f6-b12a-66ea81845a17 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:12.793988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f8f9ccd-fa32-42f6-b12a-66ea81845a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:12.818764 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 928/1857] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:12.905665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:12.908387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:13.013298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 930/1858] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:13.020974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b381ae-0ac5-4129-b99c-ca3e301b5306 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.021261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b381ae-0ac5-4129-b99c-ca3e301b5306 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.021538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b381ae-0ac5-4129-b99c-ca3e301b5306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.081579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-75b381ae-0ac5-4129-b99c-ca3e301b5306 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:13.084171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-75b381ae-0ac5-4129-b99c-ca3e301b5306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:13.105150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 931/1859] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:13.111065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b381ae-0ac5-4129-b99c-ca3e301b5306 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:13.138163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6b452-2b7d-4074-82c0-06cbe92e8ac0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:13.159729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b381ae-0ac5-4129-b99c-ca3e301b5306 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:13.172687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:13.175062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.175482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.175769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.176444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:13.176746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:13.179388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:13.204794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 932/1860] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:13.205843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:13.236652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6489f1f-1edd-450b-b28b-2c91cf2e138b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:13.243341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:13.243960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.244245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.244518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.247273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:13.249234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:13.311361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 933/1861] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:13 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:13.312602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:13.384354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:13.398377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:13.401926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.402566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.404048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.429184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:13.450973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f7ee-e806-4b1b-92dc-6ade4ebbed84 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:13.495120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:13.495735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.496016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.496314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.496944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:13.498946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:13.556079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 934/1862] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:13 2022] POST /identity/v3/users => generated 305 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:13.561338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:13.591511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04a41-c365-4131-95f9-efe443304695 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:13.605808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:13.608002 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.608291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.609990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.612282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:13.618647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:13.621008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:13.623010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:13.649410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 935/1863] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:13.650072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 929/1864] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:13.660496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:13.692981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b58f0d-03a6-4c5b-93aa-787fd5fa5313 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:13.721706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bc0d2-2c70-46d6-86b3-97b958d21cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:13.722460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc0d2-2c70-46d6-86b3-97b958d21cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.722816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc0d2-2c70-46d6-86b3-97b958d21cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.723161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc0d2-2c70-46d6-86b3-97b958d21cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.723884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc0d2-2c70-46d6-86b3-97b958d21cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:13.728138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc0d2-2c70-46d6-86b3-97b958d21cb8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:13.754960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 936/1865] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:13.758942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:13.773020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25316-46c6-4a8d-a325-eb9ca7052776 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:13.780102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:13.781150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.781603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.782021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] PATH_INFO: `/v3/projects/1a2235f9a2b14004ac21e25f60178626/users/a67abbcf72574b19891626ac230a31fb/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.830833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2235f9a2b14004ac21e25f60178626, user_id=a67abbcf72574b19891626ac230a31fb, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:13.836552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:13.868124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 930/1866] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:13 2022] PUT /identity/v3/projects/1a2235f9a2b14004ac21e25f60178626/users/a67abbcf72574b19891626ac230a31fb/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:13.878720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d4762-5b7d-4bab-87a1-7f1b792ebae6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:13.879019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d4762-5b7d-4bab-87a1-7f1b792ebae6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:13.879653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d4762-5b7d-4bab-87a1-7f1b792ebae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:13.976001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2f3d4762-5b7d-4bab-87a1-7f1b792ebae6 None None] MFA Rules not processed for user `a67abbcf72574b19891626ac230a31fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:13.979734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f3d4762-5b7d-4bab-87a1-7f1b792ebae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:14.188872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 937/1867] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:14.192571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:14.449099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13355-b014-4237-aac6-d0eee6d560b3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:14.456793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:14.464086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:14.464932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:14.465933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:14.476631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:14.479059 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:14.523853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 931/1868] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:14 2022] POST /identity/v3/projects => generated 409 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:14.528764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d4762-5b7d-4bab-87a1-7f1b792ebae6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:14.562141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d4762-5b7d-4bab-87a1-7f1b792ebae6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:14.743642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:14.744291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:14.744572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:14.744847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:14.748136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:14.750195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:14.793161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 938/1869] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:14 2022] POST /identity/v3/users => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:14.796175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:14.808732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8b36-89b1-4663-aa49-a7bc4560b104 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:14.831534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:14.835152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:14.835871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:14.837130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:14.838158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:14.843391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:14.929670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 932/1870] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:14.938052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:14.954027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27893a5-a5c0-4617-856b-1e72f876ab52 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:14.970568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:14.972352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:14.973118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:14.973947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] PATH_INFO: `/v3/projects/3af98e312f164ccd8071812f08a56203/users/bcf4f83e815f4712808064e21c298768/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:15.014800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af98e312f164ccd8071812f08a56203, user_id=bcf4f83e815f4712808064e21c298768, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:15.031009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:15.032542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:15.055925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 939/1871] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:14 2022] PUT /identity/v3/projects/3af98e312f164ccd8071812f08a56203/users/bcf4f83e815f4712808064e21c298768/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:15.060878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:15.088406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0a00-531e-49ed-b385-0bd1bfd2f28d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:15.181944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:15.212032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461ce05-ab5e-4ef3-8a46-9a00440837cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:15.212766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461ce05-ab5e-4ef3-8a46-9a00440837cb admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:15.213032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461ce05-ab5e-4ef3-8a46-9a00440837cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:15.213637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461ce05-ab5e-4ef3-8a46-9a00440837cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:15.226671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461ce05-ab5e-4ef3-8a46-9a00440837cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:15.226671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461ce05-ab5e-4ef3-8a46-9a00440837cb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:15.241554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 933/1872] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:15.245627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:15.270048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed79a-c81c-48f3-9c5e-6df71661be97 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:15.281474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:15.282700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:15.283160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:15.284475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] PATH_INFO: `/v3/projects/3af98e312f164ccd8071812f08a56203/users/bcf4f83e815f4712808064e21c298768/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:15.296232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af98e312f164ccd8071812f08a56203, user_id=bcf4f83e815f4712808064e21c298768, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:15.306910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:15.340240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 940/1873] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:15 2022] PUT /identity/v3/projects/3af98e312f164ccd8071812f08a56203/users/bcf4f83e815f4712808064e21c298768/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:15.341800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08239-1835-47a3-8af7-399beee753ba None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:15.342170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08239-1835-47a3-8af7-399beee753ba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:15.342542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08239-1835-47a3-8af7-399beee753ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:15.389376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-23e08239-1835-47a3-8af7-399beee753ba None None] MFA Rules not processed for user `bcf4f83e815f4712808064e21c298768`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:15.391606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-23e08239-1835-47a3-8af7-399beee753ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:15.557271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 934/1874] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:15 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:15.575335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:15.614713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08239-1835-47a3-8af7-399beee753ba None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:15.616743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-23e08239-1835-47a3-8af7-399beee753ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:15.692285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d914c-7ac4-497b-9400-8a54a5b0f295 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:15.696537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925b2a9-5e96-4935-9945-fb5cf02b196c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:15.697180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b2a9-5e96-4935-9945-fb5cf02b196c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:15.697521 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b2a9-5e96-4935-9945-fb5cf02b196c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:15.697805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b2a9-5e96-4935-9945-fb5cf02b196c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:15.711287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925b2a9-5e96-4935-9945-fb5cf02b196c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:15.712908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925b2a9-5e96-4935-9945-fb5cf02b196c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:15.724405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 941/1875] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:15 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:15.725272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08239-1835-47a3-8af7-399beee753ba None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:15.731391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:15.731611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:15.731746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:15.732022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] PATH_INFO: `/v3/users/48903e1aa4bd4dc3835c42ba4a8f22ed` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:15.733194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48903e1aa4bd4dc3835c42ba4a8f22ed)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:15.735555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:15.857763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48903e1aa4bd4dc3835c42ba4a8f22ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:15.883071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48903e1aa4bd4dc3835c42ba4a8f22ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:15.883827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48903e1aa4bd4dc3835c42ba4a8f22ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:15.886220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48903e1aa4bd4dc3835c42ba4a8f22ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:15.902018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48903e1aa4bd4dc3835c42ba4a8f22ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:15.935380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:15.964730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 935/1876] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:15 2022] DELETE /identity/v3/users/48903e1aa4bd4dc3835c42ba4a8f22ed => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:15.968802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:15.969203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:15.969374 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:16.032966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:16.048334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:16.074882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:16.076556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:16.183316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 942/1877] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:16.194441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:16.196370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd19b-decd-4d9f-b41a-876d0644db36 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:16.197538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:16.215949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:16.216591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:16.217300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:16.217300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:16.229388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:16.340577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:16.349208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:16.352005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b577c-e845-40ef-a41b-a23270412c9f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:16.357118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:16.357771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:16.358044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:16.358320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:16.387810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 936/1878] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:16 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:16.390767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:16.392651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:16.406419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 943/1879] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:16.650249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:16.651776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:16.676203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0bcb0-cd4a-43c3-a339-f2681ff67eac service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:16.682159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:16.682837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:16.683116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:16.683838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] PATH_INFO: `/v3/users/6bba619a976b48aab4a3d77ed68f7d2a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:16.685950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bba619a976b48aab4a3d77ed68f7d2a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:16.691886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:16.806800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bba619a976b48aab4a3d77ed68f7d2a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:16.823373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:16.824844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:16.832673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bba619a976b48aab4a3d77ed68f7d2a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:16.833366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bba619a976b48aab4a3d77ed68f7d2a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:16.834627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bba619a976b48aab4a3d77ed68f7d2a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:16.853920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34950157-28d2-4861-a47c-96d15b0e3a26 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:16.856893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d8f80997-c2f8-44bb-9eef-ad6ee3b39d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bba619a976b48aab4a3d77ed68f7d2a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:16.861450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:16.862687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:16.862972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:16.863247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] PATH_INFO: `/v3/projects/a2a1b7d7b95b400684b7ade211f92ebe` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:16.868152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a1b7d7b95b400684b7ade211f92ebe)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:16.875592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:16.921498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 937/1880] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:16 2022] DELETE /identity/v3/users/6bba619a976b48aab4a3d77ed68f7d2a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:16.926651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:16.927636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:16.927807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:16.928103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:16.960252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a1b7d7b95b400684b7ade211f92ebe', 'request_id': 'req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:16.967083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a1b7d7b95b400684b7ade211f92ebe', 'request_id': 'req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:16.970172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:16.972078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:16.978600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a1b7d7b95b400684b7ade211f92ebe', 'request_id': 'req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.006471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] The token cache is being invalidate because project a2a1b7d7b95b400684b7ade211f92ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:17.007019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.007912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.010176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 944/1881] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:16 2022] DELETE /identity/v3/projects/a2a1b7d7b95b400684b7ade211f92ebe => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:17.013211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:17.016085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:17.020252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:17.103917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 938/1882] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:17.114394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:17.115910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:17.117152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca26a50-1830-4f0f-844d-91adf9ca3a3d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:17.122321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:17.123042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:17.123327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:17.123608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] PATH_INFO: `/v3/users/6e1a5456512c4f1ca12bd2c17aee4094` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:17.124787 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1a5456512c4f1ca12bd2c17aee4094)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:17.128246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:17.186408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674757c-215b-4b5f-b0bf-9f353eb99c7b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:17.192862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1a5456512c4f1ca12bd2c17aee4094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.192862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1a5456512c4f1ca12bd2c17aee4094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.193050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:17.193050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:17.193050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:17.193050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:17.196023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1a5456512c4f1ca12bd2c17aee4094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.200773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:17.202471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:17.204973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1a5456512c4f1ca12bd2c17aee4094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.212656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 939/1883] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:17.219647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1a5456512c4f1ca12bd2c17aee4094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.227201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 945/1884] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:17 2022] DELETE /identity/v3/users/6e1a5456512c4f1ca12bd2c17aee4094 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:17.740870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:17.751536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ebf9-d620-4ebc-b96e-594833d68646 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:17.791067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:17.793373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:17.822814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:17.823533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:17.824048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:17.824320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] PATH_INFO: `/v3/projects/f2afd97113884ddebf4896850a3db0a3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:17.825501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2afd97113884ddebf4896850a3db0a3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:17.827622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:17.833263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:17.865498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f14ea-c5f8-458b-a0b7-a8f99430b407 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:17.875913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2afd97113884ddebf4896850a3db0a3', 'request_id': 'req-40159285-e91b-4713-b83d-265f4a508568'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.882651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2afd97113884ddebf4896850a3db0a3', 'request_id': 'req-40159285-e91b-4713-b83d-265f4a508568'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.890699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2afd97113884ddebf4896850a3db0a3', 'request_id': 'req-40159285-e91b-4713-b83d-265f4a508568'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.892931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:17.905627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] The token cache is being invalidate because project f2afd97113884ddebf4896850a3db0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:17.906121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.906958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40159285-e91b-4713-b83d-265f4a508568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:17.908515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 940/1885] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:17 2022] DELETE /identity/v3/projects/f2afd97113884ddebf4896850a3db0a3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:17.913284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f34e8-19a9-4450-abd4-756dbad79322 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:17.913584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f34e8-19a9-4450-abd4-756dbad79322 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:17.913869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f34e8-19a9-4450-abd4-756dbad79322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:17.928717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:17.929455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:17.929810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:17.930160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] PATH_INFO: `/v3/projects/3ceea36371ce45ecaabdfc515bd83b92` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:17.931492 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ceea36371ce45ecaabdfc515bd83b92)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:17.934288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:17.939038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-895f34e8-19a9-4450-abd4-756dbad79322 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:17.940866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-895f34e8-19a9-4450-abd4-756dbad79322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:17.966976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 941/1886] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:17.966976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597fdb-e851-4f55-90c0-cd7ac4f9df62 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:17.966976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597fdb-e851-4f55-90c0-cd7ac4f9df62 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:17.966976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597fdb-e851-4f55-90c0-cd7ac4f9df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:17.994753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4f597fdb-e851-4f55-90c0-cd7ac4f9df62 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:17.996238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4f597fdb-e851-4f55-90c0-cd7ac4f9df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:18.014729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ceea36371ce45ecaabdfc515bd83b92', 'request_id': 'req-2c765573-002c-4cb6-9397-b422b48a597a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.022556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ceea36371ce45ecaabdfc515bd83b92', 'request_id': 'req-2c765573-002c-4cb6-9397-b422b48a597a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.032572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ceea36371ce45ecaabdfc515bd83b92', 'request_id': 'req-2c765573-002c-4cb6-9397-b422b48a597a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.047034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] The token cache is being invalidate because project 3ceea36371ce45ecaabdfc515bd83b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:18.047332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.048310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.050731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 946/1887] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:17 2022] DELETE /identity/v3/projects/3ceea36371ce45ecaabdfc515bd83b92 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:18.055085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.057110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:18.064668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 942/1888] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:18.069777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597fdb-e851-4f55-90c0-cd7ac4f9df62 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.073100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765573-002c-4cb6-9397-b422b48a597a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:18.078600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:18.079288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.079576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.079863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] PATH_INFO: `/v3/users/95e0c66c31584840a5b7319c61a24fda` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.081039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597fdb-e851-4f55-90c0-cd7ac4f9df62 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:18.081191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e0c66c31584840a5b7319c61a24fda)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:18.083110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:18.086985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:18.087591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.087912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.088167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.088782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:18.089085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:18.090762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:18.107181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 943/1889] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:36:18.113377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.150488 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263c07-07be-4dff-9813-aa8682e3e94f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:18.164178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:18.164803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.165086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.165365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.169231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:18.173129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:18.184979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e0c66c31584840a5b7319c61a24fda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.185690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e0c66c31584840a5b7319c61a24fda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.199478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e0c66c31584840a5b7319c61a24fda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.211660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e0c66c31584840a5b7319c61a24fda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.213204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:18.225523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 944/1890] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:18 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:18.232268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.235120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e0c66c31584840a5b7319c61a24fda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:18.243505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 947/1891] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:18 2022] DELETE /identity/v3/users/95e0c66c31584840a5b7319c61a24fda => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:18.349304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee538-f96a-4729-a185-f62a4c5f5952 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:18.424575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:18.435408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:18.436872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.437157 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.437669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.438506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:18.441318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:18.479235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 945/1892] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:18 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:18.483387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.485123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:18.517327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfa1bb-e363-4001-8b6a-4c563173b9e3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:18.522878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:18.523506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.523788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.524063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.524783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:18.526503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:18.538044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 948/1893] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:18.542193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.563570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99df1f-433e-4592-a212-69535e613ffa admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:18.576052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a539a1-77a4-44c9-9cea-b92b1fb09592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:18.576813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a539a1-77a4-44c9-9cea-b92b1fb09592 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.577211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a539a1-77a4-44c9-9cea-b92b1fb09592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.577797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a539a1-77a4-44c9-9cea-b92b1fb09592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.578563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a539a1-77a4-44c9-9cea-b92b1fb09592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:18.580590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a539a1-77a4-44c9-9cea-b92b1fb09592 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:18.594392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 946/1894] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:18.603801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.617367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae8bb7-cb6f-449d-aa6f-d70e10044365 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:18.622792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:18.623642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.624050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.624450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] PATH_INFO: `/v3/projects/3d472e6296964df486c5a6145cf0c927/users/b5452a6fb43246c2a2fc325a869ffbc4/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.644071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d472e6296964df486c5a6145cf0c927, user_id=b5452a6fb43246c2a2fc325a869ffbc4, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:18.647081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:18.693920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 949/1895] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:18 2022] PUT /identity/v3/projects/3d472e6296964df486c5a6145cf0c927/users/b5452a6fb43246c2a2fc325a869ffbc4/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:18.709048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:18.709334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:18.709658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:18.743022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] MFA Rules not processed for user `b5452a6fb43246c2a2fc325a869ffbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:18.744523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:18.842396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 947/1896] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:18.844539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.938560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:18.944345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:19.024098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35779ebc-ffae-4061-9c42-dbe7c2edccf6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.029759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.033248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.033606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.033862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.034620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.036994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.037167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d4bef-82d9-4645-a117-4364741af4cd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.042186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.042963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.043248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.043509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] PATH_INFO: `/v3/projects/1744722d2060439f8a362a611f0c0518` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.044644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1744722d2060439f8a362a611f0c0518)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.046673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.074115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 950/1897] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:18 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:19.075156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.104480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1744722d2060439f8a362a611f0c0518', 'request_id': 'req-4334d798-3409-40b0-9aab-819262608b2c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:19.111530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1744722d2060439f8a362a611f0c0518', 'request_id': 'req-4334d798-3409-40b0-9aab-819262608b2c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:19.120065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1744722d2060439f8a362a611f0c0518', 'request_id': 'req-4334d798-3409-40b0-9aab-819262608b2c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:19.125811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:19.134002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] The token cache is being invalidate because project 1744722d2060439f8a362a611f0c0518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:19.134589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:19.135886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4334d798-3409-40b0-9aab-819262608b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:19.137694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 948/1898] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:18 2022] DELETE /identity/v3/projects/1744722d2060439f8a362a611f0c0518 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:19.143942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57eb9-33b3-4523-a5a3-7cf652970d46 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.144418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57eb9-33b3-4523-a5a3-7cf652970d46 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.144698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57eb9-33b3-4523-a5a3-7cf652970d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.149014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc1e1b-126d-4dfb-80e9-61997aa84671 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.165373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-02c57eb9-33b3-4523-a5a3-7cf652970d46 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:19.166611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-02c57eb9-33b3-4523-a5a3-7cf652970d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:19.188760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:19.236508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.237545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.237917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.238535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.239181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.242526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.265171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 949/1899] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:19.281037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e2c2-531e-4aec-a410-ac1609edb066 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.281037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e2c2-531e-4aec-a410-ac1609edb066 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.281313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e2c2-531e-4aec-a410-ac1609edb066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.295616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 951/1900] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:19.300954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.303863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:19.309931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2fa7e2c2-531e-4aec-a410-ac1609edb066 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:19.313376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2fa7e2c2-531e-4aec-a410-ac1609edb066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:19.321962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003bfa-634e-46a2-977b-0b15a96a5f34 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.325540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 950/1901] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:19.329776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e2c2-531e-4aec-a410-ac1609edb066 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.333677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.334318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.334647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.334925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.335592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.344666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.353023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e2c2-531e-4aec-a410-ac1609edb066 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.354211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 952/1902] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:19.355494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.356244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.357362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.357800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.358243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.359905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:19.362897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.365011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.368928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716f3f-5763-413c-80d8-03defd7bf928 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.376416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.377283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.377631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.378011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] PATH_INFO: `/v3/projects/9cae683bd2a84fdb91b6394c4d6e368e/users/2a0eb3abd2cd4905842c78e43e95252d/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.384584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 951/1903] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:19.388821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.398685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cae683bd2a84fdb91b6394c4d6e368e, user_id=2a0eb3abd2cd4905842c78e43e95252d, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.401507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.402145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af68e5-49a4-4a02-909e-9af0ee877465 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.408962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.409761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.409923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.410219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.410918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.412956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.420427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 953/1904] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:19 2022] PUT /identity/v3/projects/9cae683bd2a84fdb91b6394c4d6e368e/users/2a0eb3abd2cd4905842c78e43e95252d/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:19.425261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.448270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 952/1905] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:19.449388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.526026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977f39-4cf5-40ce-9542-bdb95f2a2d75 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.532296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033465c-1925-4c6f-bc00-cdb28e1f0c3e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.535850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.536478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.536758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.537033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.537739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.538560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.539357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.539561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.539707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.540363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.541315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.544737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.554623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 954/1906] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:19.555716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.570608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d47a9f-5a96-42c8-90da-005f08970075 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.575877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 953/1907] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:19.576803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05142127-9aea-4282-a4cb-ce6969781f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.577479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05142127-9aea-4282-a4cb-ce6969781f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.580516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05142127-9aea-4282-a4cb-ce6969781f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.580516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05142127-9aea-4282-a4cb-ce6969781f8b admin admin] PATH_INFO: `/v3/projects/9cae683bd2a84fdb91b6394c4d6e368e/users/2a0eb3abd2cd4905842c78e43e95252d/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.580707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.582880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05142127-9aea-4282-a4cb-ce6969781f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cae683bd2a84fdb91b6394c4d6e368e, user_id=2a0eb3abd2cd4905842c78e43e95252d, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.586067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05142127-9aea-4282-a4cb-ce6969781f8b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.599378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 955/1908] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:19 2022] PUT /identity/v3/projects/9cae683bd2a84fdb91b6394c4d6e368e/users/2a0eb3abd2cd4905842c78e43e95252d/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:19.605104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8809a6-59f1-442d-aee1-6f21751979ad admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.610556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f775bd-e9db-42b2-98dd-c6d491477c8e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.610725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f775bd-e9db-42b2-98dd-c6d491477c8e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.611000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f775bd-e9db-42b2-98dd-c6d491477c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.650684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-57f775bd-e9db-42b2-98dd-c6d491477c8e None None] MFA Rules not processed for user `2a0eb3abd2cd4905842c78e43e95252d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:19.652268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-57f775bd-e9db-42b2-98dd-c6d491477c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:19.687958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:19.717911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.718939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.719459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.719895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.720583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.722913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.737182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 954/1909] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:19.740890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.743307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:19.747381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 956/1910] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:19.754060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96650-97f0-44d9-bc30-f8207c246f4a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.758909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.759709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.759991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.760270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.762287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.763941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.779509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 955/1911] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:19.780693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f775bd-e9db-42b2-98dd-c6d491477c8e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.792823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f775bd-e9db-42b2-98dd-c6d491477c8e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.797750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac7369-765b-4d3b-9550-7a84dbd6552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:19.799943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7369-765b-4d3b-9550-7a84dbd6552d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.799943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7369-765b-4d3b-9550-7a84dbd6552d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.799943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7369-765b-4d3b-9550-7a84dbd6552d admin admin] PATH_INFO: `/v3/projects/530e5f0d9ece42658869054cc1df2625/users/27f3e184c8564ac6a7b3da133ee0990f/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.815277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac7369-765b-4d3b-9550-7a84dbd6552d admin admin] RBAC: Authorizing `identity:create_grant(project_id=530e5f0d9ece42658869054cc1df2625, user_id=27f3e184c8564ac6a7b3da133ee0990f, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:19.818207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac7369-765b-4d3b-9550-7a84dbd6552d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:19.824156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:19.827444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:19.835411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 957/1912] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:19 2022] PUT /identity/v3/projects/530e5f0d9ece42658869054cc1df2625/users/27f3e184c8564ac6a7b3da133ee0990f/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:19.847519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f829-7e99-4d45-8154-bfba3ddb8438 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:19.848115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f829-7e99-4d45-8154-bfba3ddb8438 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:19.848299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f829-7e99-4d45-8154-bfba3ddb8438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:19.899091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1814f829-7e99-4d45-8154-bfba3ddb8438 None None] MFA Rules not processed for user `27f3e184c8564ac6a7b3da133ee0990f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:19.900593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1814f829-7e99-4d45-8154-bfba3ddb8438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:19.917871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da94f39-26ed-48db-a050-8174410d66c7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:19.990514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 958/1913] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:19.995562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f829-7e99-4d45-8154-bfba3ddb8438 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:20.012625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.013445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.014078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.014300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.017585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:20.121943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f829-7e99-4d45-8154-bfba3ddb8438 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:20.123216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:20.125761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:20.128866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.129504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.129802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.130056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.130859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:20.133104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:20.140988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 956/1914] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:20.184118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 959/1915] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:19 2022] POST /identity/v3/projects => generated 401 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:20.186117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:20.203460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841dd1c-0a59-4a01-bc81-9593aae15c8c service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:20.258225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:20.303958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.305062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.305483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.305822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.306717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:20.308953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:20.338865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 957/1916] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:20 2022] POST /identity/v3/users => generated 307 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:20.343300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:20.360741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396700c-8e63-4eee-9bbb-fc863e861664 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:20.367273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.368022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.368479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.368825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.369617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:20.371690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:20.394817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 960/1917] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:20.396393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:20.413779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2e3e-2015-4769-9971-be52895e05e6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:20.445852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.447346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.447630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.447906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] PATH_INFO: `/v3/projects/869b7205fe72467c975ed992e7e75695/users/ecf781cf80f544cebc5408a5c80a01b0/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.488308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b7205fe72467c975ed992e7e75695, user_id=ecf781cf80f544cebc5408a5c80a01b0, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:20.494782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:20.529810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 958/1918] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:20 2022] PUT /identity/v3/projects/869b7205fe72467c975ed992e7e75695/users/ecf781cf80f544cebc5408a5c80a01b0/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:20.534285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:20.544533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1ead3-5311-40f7-aae8-9f4df2aa5269 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:20.600880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:20.632994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd2ca9-7dbf-4f3b-a432-daa4d333d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.633725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2ca9-7dbf-4f3b-a432-daa4d333d856 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.634080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2ca9-7dbf-4f3b-a432-daa4d333d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.634440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2ca9-7dbf-4f3b-a432-daa4d333d856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.635241 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd2ca9-7dbf-4f3b-a432-daa4d333d856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:20.637404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd2ca9-7dbf-4f3b-a432-daa4d333d856 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:20.656602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 961/1919] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:20.658038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:20.673863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4ed7-d75e-4c92-b956-f285f6bd9708 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:20.681395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.682640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.683305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.683802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] PATH_INFO: `/v3/projects/869b7205fe72467c975ed992e7e75695/users/ecf781cf80f544cebc5408a5c80a01b0/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.686667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b7205fe72467c975ed992e7e75695, user_id=ecf781cf80f544cebc5408a5c80a01b0, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:20.691202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:20.716358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 959/1920] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:20 2022] PUT /identity/v3/projects/869b7205fe72467c975ed992e7e75695/users/ecf781cf80f544cebc5408a5c80a01b0/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:20.718299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.727533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.727875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:20.761028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] MFA Rules not processed for user `ecf781cf80f544cebc5408a5c80a01b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:20.767501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:20.857553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 962/1921] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:20 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:20.869666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:20.983036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18329ad-a662-4434-9f4e-6775f9f8ffba admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:20.988083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:20.988827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:20.989235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:20.989596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:21.002886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:21.004753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:21.016840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 960/1922] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:20 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:21.064026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:21.066223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:21.132405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:21.141979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec31a2-fc70-41e6-9d19-cd9631f40bb8 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:21.146135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc074a97-53d5-40bc-b5e0-19017d8eed2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:21.146789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc074a97-53d5-40bc-b5e0-19017d8eed2d service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:21.147071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc074a97-53d5-40bc-b5e0-19017d8eed2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:21.147347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc074a97-53d5-40bc-b5e0-19017d8eed2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:21.156583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c3e69-0289-49e2-ae92-cbae012e13bb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:21.161794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:21.162633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:21.162912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:21.163226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] PATH_INFO: `/v3/users/a0b0b8c8f92649a490270f18c2f45921` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:21.164407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b0b8c8f92649a490270f18c2f45921)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:21.166325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:21.218546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b0b8c8f92649a490270f18c2f45921'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.219528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b0b8c8f92649a490270f18c2f45921'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.222162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc074a97-53d5-40bc-b5e0-19017d8eed2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:21.224257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc074a97-53d5-40bc-b5e0-19017d8eed2d service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:21.228601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b0b8c8f92649a490270f18c2f45921'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.234495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 961/1923] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:21.241410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b0b8c8f92649a490270f18c2f45921'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.242794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:21.267015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b0b8c8f92649a490270f18c2f45921'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.280018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 963/1924] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:21 2022] DELETE /identity/v3/users/a0b0b8c8f92649a490270f18c2f45921 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:21.284808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:21.285097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:21.285377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:21.309844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:21.311390 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:21.355921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:21.404316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:21.407094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 962/1925] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:21.410490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:21.484893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d2ab-6585-4b8d-b906-a4d96f0bee70 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:21.493389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:21.494024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:21.494323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:21.494613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:21.505614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:21.507281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:21.522965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 964/1926] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:21.835423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:21.837672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:21.871266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f46b8b-1ff2-4561-b06b-8b6cd778958d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:21.877063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:21.877764 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:21.878046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:21.878324 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] PATH_INFO: `/v3/projects/c8a636df0452431b8bb07d8c50bea2ff` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:21.879505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a636df0452431b8bb07d8c50bea2ff)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:21.881461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:21.936603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a636df0452431b8bb07d8c50bea2ff', 'request_id': 'req-89dadf64-866a-4218-9b68-5dd2e63b623e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.944882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a636df0452431b8bb07d8c50bea2ff', 'request_id': 'req-89dadf64-866a-4218-9b68-5dd2e63b623e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.953377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a636df0452431b8bb07d8c50bea2ff', 'request_id': 'req-89dadf64-866a-4218-9b68-5dd2e63b623e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.974678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] The token cache is being invalidate because project c8a636df0452431b8bb07d8c50bea2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:21.974976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.975909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:21.977492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 963/1927] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:21 2022] DELETE /identity/v3/projects/c8a636df0452431b8bb07d8c50bea2ff => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:21.981262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:21.982744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:21.989378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:21.996791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:22.002308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea7be0-72ba-48e3-af7d-3564da18a3f9 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:22.123530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:22.124901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:22.125302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:22.126218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] PATH_INFO: `/v3/users/a67abbcf72574b19891626ac230a31fb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:22.127926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67abbcf72574b19891626ac230a31fb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:22.130903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:22.151622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dadf64-866a-4218-9b68-5dd2e63b623e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:22.164727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:22.165395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:22.165683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:22.165991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] PATH_INFO: `/v3/users/9246b0dbde184867ba4c65b01fe47e3f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:22.167129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9246b0dbde184867ba4c65b01fe47e3f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:22.169255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:22.222601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67abbcf72574b19891626ac230a31fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.230604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9246b0dbde184867ba4c65b01fe47e3f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.231100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67abbcf72574b19891626ac230a31fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.241879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67abbcf72574b19891626ac230a31fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.244095 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9246b0dbde184867ba4c65b01fe47e3f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.244894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9246b0dbde184867ba4c65b01fe47e3f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.245528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9246b0dbde184867ba4c65b01fe47e3f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.249713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67abbcf72574b19891626ac230a31fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.250474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:22.258388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9246b0dbde184867ba4c65b01fe47e3f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.270723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7214fed9-ce41-4480-baf3-a35b22788146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67abbcf72574b19891626ac230a31fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.277516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 965/1928] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:21 2022] DELETE /identity/v3/users/a67abbcf72574b19891626ac230a31fb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:22.280822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 964/1929] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:21 2022] DELETE /identity/v3/users/9246b0dbde184867ba4c65b01fe47e3f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:22.282158 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:22.282491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:22.282803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:22.290377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:22.315605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:22.317152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:22.390986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 966/1930] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:22.402140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:22.403731 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:22.470133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e9cbd-4b5f-4053-8d0b-1e3c83d726cc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:22.474684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bae0f5-c905-4eb9-be87-cf8e3bec900b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:22.475307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bae0f5-c905-4eb9-be87-cf8e3bec900b service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:22.475598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bae0f5-c905-4eb9-be87-cf8e3bec900b service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:22.475907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bae0f5-c905-4eb9-be87-cf8e3bec900b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:22.485893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bae0f5-c905-4eb9-be87-cf8e3bec900b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:22.487799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bae0f5-c905-4eb9-be87-cf8e3bec900b service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:22.498615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 965/1931] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:22.663985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:22.665936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:22.679752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be02ba-c46a-4534-b13a-d8f412464f79 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:22.685569 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:22.686339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:22.686650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:22.686924 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] PATH_INFO: `/v3/projects/d6acbe9a120c45ff9b8536f0a487d2b0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:22.688186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6acbe9a120c45ff9b8536f0a487d2b0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:22.696653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:22.791682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6acbe9a120c45ff9b8536f0a487d2b0', 'request_id': 'req-4328bf5b-8759-4084-8356-544d36a98ac6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.804207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6acbe9a120c45ff9b8536f0a487d2b0', 'request_id': 'req-4328bf5b-8759-4084-8356-544d36a98ac6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.819251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6acbe9a120c45ff9b8536f0a487d2b0', 'request_id': 'req-4328bf5b-8759-4084-8356-544d36a98ac6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.842245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] The token cache is being invalidate because project d6acbe9a120c45ff9b8536f0a487d2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:22.842897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.843702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:22.847125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 967/1932] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:22 2022] DELETE /identity/v3/projects/d6acbe9a120c45ff9b8536f0a487d2b0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:22.852708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ac5b1-561a-47a1-a7c9-09866610c305 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:22.853158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ac5b1-561a-47a1-a7c9-09866610c305 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:22.853616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ac5b1-561a-47a1-a7c9-09866610c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:22.881082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-563ac5b1-561a-47a1-a7c9-09866610c305 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:22.883252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-563ac5b1-561a-47a1-a7c9-09866610c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:22.954980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:22.958511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:22.998422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 966/1933] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:23.000631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eabd77-3b5c-4553-88bd-b144c5b9eb5c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.001068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eabd77-3b5c-4553-88bd-b144c5b9eb5c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.001346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eabd77-3b5c-4553-88bd-b144c5b9eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.041309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c1eabd77-3b5c-4553-88bd-b144c5b9eb5c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:23.055354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c1eabd77-3b5c-4553-88bd-b144c5b9eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.065574 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 967/1934] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:23.070522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eabd77-3b5c-4553-88bd-b144c5b9eb5c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.083219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328bf5b-8759-4084-8356-544d36a98ac6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:23.084278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eabd77-3b5c-4553-88bd-b144c5b9eb5c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:23.092944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:23.093594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.093871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.095721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:23.097046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] PATH_INFO: `/v3/projects/1a2235f9a2b14004ac21e25f60178626` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.098150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.098455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.099297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2235f9a2b14004ac21e25f60178626)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:23.101230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:23.102125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.102968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:23.103368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:23.105197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:23.138445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 968/1935] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:23.155012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.168744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744668d-a2eb-4cc9-bee9-70995838153b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:23.183272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:23.183472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:23.184245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.184511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.184813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.189182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:23.193114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:23.232030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2235f9a2b14004ac21e25f60178626', 'request_id': 'req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.246762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2235f9a2b14004ac21e25f60178626', 'request_id': 'req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.260021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 969/1936] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:23 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:23.261467 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.264114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.289945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2235f9a2b14004ac21e25f60178626', 'request_id': 'req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.320584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] The token cache is being invalidate because project 1a2235f9a2b14004ac21e25f60178626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:23.320949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.321995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.324248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 968/1937] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:22 2022] DELETE /identity/v3/projects/1a2235f9a2b14004ac21e25f60178626 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:23.325286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.340482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.356063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:23.381916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698abc6-a56a-443a-9deb-c49bdc62137c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:23.387737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:23.388960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.389958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.390797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.394940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.473311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfb9d0-d2ba-4869-b356-3cfc245db2bd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:23.488461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:23.490096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:23.523039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 970/1938] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:23.524306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.528226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.542735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e831-dfd7-4ec4-b6d7-2295e8dd2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:23.543780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e831-dfd7-4ec4-b6d7-2295e8dd2c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.544295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e831-dfd7-4ec4-b6d7-2295e8dd2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.544894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e831-dfd7-4ec4-b6d7-2295e8dd2c01 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.551257 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e831-dfd7-4ec4-b6d7-2295e8dd2c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:23.557745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e831-dfd7-4ec4-b6d7-2295e8dd2c01 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:23.607119 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 969/1939] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:23 2022] POST /identity/v3/users => generated 285 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:23.608814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8562c-7d6b-40db-a259-36d26eaed69e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.609059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8562c-7d6b-40db-a259-36d26eaed69e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.609471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8562c-7d6b-40db-a259-36d26eaed69e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.614329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 970/1940] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:36:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:36:23.615377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8562c-7d6b-40db-a259-36d26eaed69e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.632946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8562c-7d6b-40db-a259-36d26eaed69e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:23.639075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea75c4-3644-47d7-864c-0cca9e8e4885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:23.639851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea75c4-3644-47d7-864c-0cca9e8e4885 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.640126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea75c4-3644-47d7-864c-0cca9e8e4885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.640399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea75c4-3644-47d7-864c-0cca9e8e4885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.641198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea75c4-3644-47d7-864c-0cca9e8e4885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:23.644038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea75c4-3644-47d7-864c-0cca9e8e4885 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:23.656462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 971/1941] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:23.657656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90001-5b17-4452-8070-eb613347713c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.657949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90001-5b17-4452-8070-eb613347713c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.658228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90001-5b17-4452-8070-eb613347713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.678248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947e4d-63e2-4337-b870-4af457dec542 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:23.684531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:23.686028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:23.687557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:23.687953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] PATH_INFO: `/v3/users/bcf4f83e815f4712808064e21c298768` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:23.692541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf4f83e815f4712808064e21c298768)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:23.696875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:23.706172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eda90001-5b17-4452-8070-eb613347713c None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:23.707454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eda90001-5b17-4452-8070-eb613347713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.766705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf4f83e815f4712808064e21c298768'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.779071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf4f83e815f4712808064e21c298768'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.779772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf4f83e815f4712808064e21c298768'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.780460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf4f83e815f4712808064e21c298768'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.785953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:23.801302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf4f83e815f4712808064e21c298768'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:23.826633 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 971/1942] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:23 2022] DELETE /identity/v3/users/bcf4f83e815f4712808064e21c298768 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:23.827754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.829353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.837332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 972/1943] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:36:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:23.850938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:23.867047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90001-5b17-4452-8070-eb613347713c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:23.868300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eda90001-5b17-4452-8070-eb613347713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:23.903047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90001-5b17-4452-8070-eb613347713c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.005679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4409-531b-4af6-a343-34c104becfa3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.011551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.012184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.012520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.012805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.014312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.016841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.027373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42b50-8f9d-4fbb-81a0-59d2b2a31fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.028134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42b50-8f9d-4fbb-81a0-59d2b2a31fe5 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.028523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42b50-8f9d-4fbb-81a0-59d2b2a31fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.028907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42b50-8f9d-4fbb-81a0-59d2b2a31fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.035737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 972/1944] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:24.038183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.043307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c42b50-8f9d-4fbb-81a0-59d2b2a31fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.045573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c42b50-8f9d-4fbb-81a0-59d2b2a31fe5 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.061190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 973/1945] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:24.101429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba1117-440d-4203-b8c6-bffbcca27f60 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.114801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.127459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.127795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.128172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] PATH_INFO: `/v3/projects/ab29f2add50c49a88983c4065b962aa3/users/9f8cf2e448834adc8c211fe801775c67/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.154590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab29f2add50c49a88983c4065b962aa3, user_id=9f8cf2e448834adc8c211fe801775c67, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.157336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.173925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 973/1946] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:24 2022] PUT /identity/v3/projects/ab29f2add50c49a88983c4065b962aa3/users/9f8cf2e448834adc8c211fe801775c67/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:24.185393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.185932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.186098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.222949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] MFA Rules not processed for user `9f8cf2e448834adc8c211fe801775c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:24.224918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:24.354099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 974/1947] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:24.360039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.367423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.369375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:24.507881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:24.548505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26f6fa-e00e-4e95-90fc-ab05028c786e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.558384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ea7f4-fbcc-4d95-a6d6-dfadd20c600c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.563266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.564224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.564508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.564816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] PATH_INFO: `/v3/projects/3af98e312f164ccd8071812f08a56203` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.570126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af98e312f164ccd8071812f08a56203)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.572352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.577662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.578380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.578974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.579410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.582199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.588713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.669834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 974/1948] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:24 2022] POST /identity/v3/projects => generated 369 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:24.674313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.715732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af98e312f164ccd8071812f08a56203', 'request_id': 'req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:24.735952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af98e312f164ccd8071812f08a56203', 'request_id': 'req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:24.748972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af98e312f164ccd8071812f08a56203', 'request_id': 'req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:24.769990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] The token cache is being invalidate because project 3af98e312f164ccd8071812f08a56203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:24.769990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:24.771474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0241ea1f-c4a7-4c11-b532-5bbbbab60f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:24.779124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 975/1949] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:24 2022] DELETE /identity/v3/projects/3af98e312f164ccd8071812f08a56203 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:24.781322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a561-a6f2-4b90-88e2-5c58afa5f885 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.781577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a561-a6f2-4b90-88e2-5c58afa5f885 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.781912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a561-a6f2-4b90-88e2-5c58afa5f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.808642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9478a561-a6f2-4b90-88e2-5c58afa5f885 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:24.809941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9478a561-a6f2-4b90-88e2-5c58afa5f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:24.811007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dac96-86a4-4c10-bae8-f372e01742d1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.821748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:24.883445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 976/1950] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:24.886220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.886876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.887158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.887429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.888065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.890634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.891131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550e56-caa8-4757-b88e-b5d91ea2d157 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.891469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550e56-caa8-4757-b88e-b5d91ea2d157 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.891799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550e56-caa8-4757-b88e-b5d91ea2d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.912914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2d550e56-caa8-4757-b88e-b5d91ea2d157 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:24.914123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d550e56-caa8-4757-b88e-b5d91ea2d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:24.918166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 975/1951] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:24 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:24.919238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.920894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:24.922571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 977/1952] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:24.926498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550e56-caa8-4757-b88e-b5d91ea2d157 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.933448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e77d54-6794-4271-9c7b-b794049098f9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.936458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550e56-caa8-4757-b88e-b5d91ea2d157 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.938452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.939219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.939499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.940458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.941165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.942838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.943637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.944343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.944733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.945027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.945671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:24.945970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.947860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:24.957626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 976/1953] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:24.958779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.963392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 978/1954] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:36:24.967567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:24.980819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08053d-bcdd-4fd0-b8c1-6ac047432035 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.987812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:24.988582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:24.988696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2c547-4988-4dda-83d5-8978e7f42626 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:24.988916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:24.989267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:24.990040 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:24.992816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.001412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.002013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.002878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.003156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] PATH_INFO: `/v3/projects/a94f3df048ef4994a57e211d347b14f6/users/fa0c0c3b8a62469bb4dabf3942741ac9/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.030038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 979/1955] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:24 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:25.030269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94f3df048ef4994a57e211d347b14f6, user_id=fa0c0c3b8a62469bb4dabf3942741ac9, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.031268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.034267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.062367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 977/1956] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:24 2022] PUT /identity/v3/projects/a94f3df048ef4994a57e211d347b14f6/users/fa0c0c3b8a62469bb4dabf3942741ac9/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:25.067425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.085611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:25.111829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bf190-67ff-4e72-9acf-77f4ba9e606a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.141992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcfbc3-4645-4615-812b-df30f37178fc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.147640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.158669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.159246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.159246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.159904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.162841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.185870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 978/1957] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:25.186982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.193334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.194022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.194379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.194780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.195526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.197759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.199255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38759b3a-1c8b-4ba4-9710-e03dd4beba66 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.204749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4210651-2233-4c62-b752-493a8de22b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.205446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4210651-2233-4c62-b752-493a8de22b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.205729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4210651-2233-4c62-b752-493a8de22b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.206294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4210651-2233-4c62-b752-493a8de22b67 admin admin] PATH_INFO: `/v3/projects/a94f3df048ef4994a57e211d347b14f6/users/fa0c0c3b8a62469bb4dabf3942741ac9/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.209320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4210651-2233-4c62-b752-493a8de22b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94f3df048ef4994a57e211d347b14f6, user_id=fa0c0c3b8a62469bb4dabf3942741ac9, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.212245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4210651-2233-4c62-b752-493a8de22b67 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.223978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 980/1958] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:25 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:25.224181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 979/1959] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:25 2022] PUT /identity/v3/projects/a94f3df048ef4994a57e211d347b14f6/users/fa0c0c3b8a62469bb4dabf3942741ac9/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:25.225564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.235820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff6fb-c0fc-49da-9396-9c02ec12f65d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.236252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff6fb-c0fc-49da-9396-9c02ec12f65d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.237129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff6fb-c0fc-49da-9396-9c02ec12f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.237943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fef7-67af-44e9-aa2c-8a003eb824ba admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.271834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-137ff6fb-c0fc-49da-9396-9c02ec12f65d None None] MFA Rules not processed for user `fa0c0c3b8a62469bb4dabf3942741ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:25.273134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-137ff6fb-c0fc-49da-9396-9c02ec12f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:25.316811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.317586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.317929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.318272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.319052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.320510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:25.320854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.360419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 981/1960] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:25.362272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.383149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7f66-20ba-4822-8e20-6acbb39ae033 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.391553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.392429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.392579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.394249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.395351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.396963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.401524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 980/1961] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:25.413462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 982/1962] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:25.414184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff6fb-c0fc-49da-9396-9c02ec12f65d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.417367 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.423515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:25.434881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff6fb-c0fc-49da-9396-9c02ec12f65d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.443487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba0f2-baf8-4356-a98f-7c90a61ad06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.444188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba0f2-baf8-4356-a98f-7c90a61ad06c admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.444479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba0f2-baf8-4356-a98f-7c90a61ad06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.444757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba0f2-baf8-4356-a98f-7c90a61ad06c admin admin] PATH_INFO: `/v3/projects/aa5008c7a0404918b175e7cddae98969/users/bdcbf0a7d4914f29b3d1287d018563ad/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.465350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba0f2-baf8-4356-a98f-7c90a61ad06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5008c7a0404918b175e7cddae98969, user_id=bdcbf0a7d4914f29b3d1287d018563ad, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.469889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba0f2-baf8-4356-a98f-7c90a61ad06c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.487531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 981/1963] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:25 2022] PUT /identity/v3/projects/aa5008c7a0404918b175e7cddae98969/users/bdcbf0a7d4914f29b3d1287d018563ad/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:25.497325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033adc7-bddd-40bc-9ecb-c3f2258a43d2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.497703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033adc7-bddd-40bc-9ecb-c3f2258a43d2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.498271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033adc7-bddd-40bc-9ecb-c3f2258a43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.523491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776731-9a84-4116-9364-0b50ba1eb9f5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.536841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7033adc7-bddd-40bc-9ecb-c3f2258a43d2 None None] MFA Rules not processed for user `bdcbf0a7d4914f29b3d1287d018563ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:25.538687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7033adc7-bddd-40bc-9ecb-c3f2258a43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:25.544875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:25.631976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 982/1964] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:25.636456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033adc7-bddd-40bc-9ecb-c3f2258a43d2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.637438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.638372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.638631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.638906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.717742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033adc7-bddd-40bc-9ecb-c3f2258a43d2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.719065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.721493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.724306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.724953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.725288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.725600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.726373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.728336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.733075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 983/1965] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:25.768602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 983/1966] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:25 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:25.772668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.785231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6211f-e9e1-450b-9b23-694237faca0e service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.910046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.914100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.914537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.914917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.915676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.919882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:25.961286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 984/1967] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:25 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:25.965233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:25.977243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278df465-8189-4965-a85d-58e093f574d0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:25.992881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:25.993169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:25.993355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:25.993658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:25.994339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:25.995969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:26.030778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 984/1968] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:26.036425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:26.052114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebaa4c-960f-475f-8a09-84bb17f52270 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:26.057666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:26.058504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.058869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.059210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] PATH_INFO: `/v3/projects/5298f691119b407bbab617cf9a8b2e7d/users/6141d85c4433422fabb73181d4309ef5/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.078106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5298f691119b407bbab617cf9a8b2e7d, user_id=6141d85c4433422fabb73181d4309ef5, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:26.081734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:26.101717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 985/1969] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:26 2022] PUT /identity/v3/projects/5298f691119b407bbab617cf9a8b2e7d/users/6141d85c4433422fabb73181d4309ef5/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:26.108314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:26.122565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:26.122718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044cc63-f855-4c18-bc21-302d6e763a15 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:26.125626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:26.132536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:26.178184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:26.261935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:26.264177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.264728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.276407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.277516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d117c1-f440-44c7-a4e0-6b5809b63dad admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:26.278787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:26.284214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:26.284384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:26.285168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.285864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.286449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] PATH_INFO: `/v3/users/27f3e184c8564ac6a7b3da133ee0990f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.292013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f3e184c8564ac6a7b3da133ee0990f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:26.296680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:26.321957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 985/1970] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:26.332297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:26.362535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cdfd1-b2b4-44a3-8926-20bc07e5ded1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:26.381197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59e342-1f77-429a-a102-5429fdecc56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:26.383082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e342-1f77-429a-a102-5429fdecc56a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.385380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e342-1f77-429a-a102-5429fdecc56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.385761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e342-1f77-429a-a102-5429fdecc56a admin admin] PATH_INFO: `/v3/projects/5298f691119b407bbab617cf9a8b2e7d/users/6141d85c4433422fabb73181d4309ef5/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.391225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59e342-1f77-429a-a102-5429fdecc56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5298f691119b407bbab617cf9a8b2e7d, user_id=6141d85c4433422fabb73181d4309ef5, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:26.397959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59e342-1f77-429a-a102-5429fdecc56a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:26.422301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f3e184c8564ac6a7b3da133ee0990f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:26.424428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f3e184c8564ac6a7b3da133ee0990f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:26.440147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 986/1971] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:26 2022] PUT /identity/v3/projects/5298f691119b407bbab617cf9a8b2e7d/users/6141d85c4433422fabb73181d4309ef5/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:26.451063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.453863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.454720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.463555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f3e184c8564ac6a7b3da133ee0990f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:26.501880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f3e184c8564ac6a7b3da133ee0990f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:26.533579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d17ab-47c6-4b13-a082-16e3a7fd7e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f3e184c8564ac6a7b3da133ee0990f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:26.536398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] MFA Rules not processed for user `6141d85c4433422fabb73181d4309ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:26.538007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:26.543451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 986/1972] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:26 2022] DELETE /identity/v3/users/27f3e184c8564ac6a7b3da133ee0990f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:26.548822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.549961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.550693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.604444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:26.606122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:26.669672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 987/1973] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:26.683814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:26.685403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:26.694269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 987/1974] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:26.705996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:26.708653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:26.759737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665face-d7e6-477f-803e-c220f725d8c8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:26.785715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe229ea-e792-4101-9b2a-fddfbc2df04c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:26.789993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:26.790980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.791263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.791537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.807146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:26.811464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:26.816136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:26.819389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:26.830785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:26.831406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:26.831686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:26.831962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:26.838525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 988/1975] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:26.929437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:26.930988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:26.942127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 988/1976] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:27.120668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:27.150525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b054a9-3aec-4806-a1c2-d6571a8e2882 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:27.167517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:27.168392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:27.169141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:27.169805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:27.172707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:27.269810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:27.272037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:27.281934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 989/1977] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:27.398281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:27.401384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:27.446147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ab13-dd4e-4724-852f-9e6ee47d84c6 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:27.453456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:27.454507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:27.454507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:27.455824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] PATH_INFO: `/v3/projects/530e5f0d9ece42658869054cc1df2625` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:27.458541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530e5f0d9ece42658869054cc1df2625)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:27.461535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:27.525119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530e5f0d9ece42658869054cc1df2625', 'request_id': 'req-8b795c8e-1c97-4789-8e07-14669591ecb8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.532556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530e5f0d9ece42658869054cc1df2625', 'request_id': 'req-8b795c8e-1c97-4789-8e07-14669591ecb8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.546073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530e5f0d9ece42658869054cc1df2625', 'request_id': 'req-8b795c8e-1c97-4789-8e07-14669591ecb8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.574564 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] The token cache is being invalidate because project 530e5f0d9ece42658869054cc1df2625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:27.574852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.575584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.581272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 989/1978] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:27 2022] DELETE /identity/v3/projects/530e5f0d9ece42658869054cc1df2625 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:27.583175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:27.597190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f0224-e84e-492c-8b2c-4dbfe7e994db service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:27.712348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:27.713051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:27.716083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:27.716083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] PATH_INFO: `/v3/users/ecf781cf80f544cebc5408a5c80a01b0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:27.717045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf781cf80f544cebc5408a5c80a01b0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:27.724701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:27.822169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf781cf80f544cebc5408a5c80a01b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.823682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf781cf80f544cebc5408a5c80a01b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.836185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf781cf80f544cebc5408a5c80a01b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.845747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf781cf80f544cebc5408a5c80a01b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.863648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf781cf80f544cebc5408a5c80a01b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:27.872092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 990/1979] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:27 2022] DELETE /identity/v3/users/ecf781cf80f544cebc5408a5c80a01b0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:28.223435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:28.225200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:28.242698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b795c8e-1c97-4789-8e07-14669591ecb8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:28.296128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:28.298043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:28.313658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:28.334674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:28.335329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.335612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.335891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] PATH_INFO: `/v3/projects/869b7205fe72467c975ed992e7e75695` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.337073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869b7205fe72467c975ed992e7e75695)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:28.339317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:28.355067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:28.396035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198e215-ae7f-4ef1-a3a2-e3a34f9a2987 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:28.400579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869b7205fe72467c975ed992e7e75695', 'request_id': 'req-ea53c8fe-2196-4df4-9f8c-27ead24157d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.408896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869b7205fe72467c975ed992e7e75695', 'request_id': 'req-ea53c8fe-2196-4df4-9f8c-27ead24157d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.422725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869b7205fe72467c975ed992e7e75695', 'request_id': 'req-ea53c8fe-2196-4df4-9f8c-27ead24157d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.439172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] The token cache is being invalidate because project 869b7205fe72467c975ed992e7e75695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:28.439504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.440433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea53c8fe-2196-4df4-9f8c-27ead24157d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.442181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 990/1980] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:28 2022] DELETE /identity/v3/projects/869b7205fe72467c975ed992e7e75695 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:28.448265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e5c4-051d-4a97-9c36-33b6fada5ced None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.448453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e5c4-051d-4a97-9c36-33b6fada5ced None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.448727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e5c4-051d-4a97-9c36-33b6fada5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.475922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bf07e5c4-051d-4a97-9c36-33b6fada5ced None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:28.477477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bf07e5c4-051d-4a97-9c36-33b6fada5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:28.486199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:28.487797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.488653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.489156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] PATH_INFO: `/v3/users/9f8cf2e448834adc8c211fe801775c67` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.490661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8cf2e448834adc8c211fe801775c67)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:28.492666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:28.556314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 991/1981] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:28.559763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8cf2e448834adc8c211fe801775c67'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.560442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8cf2e448834adc8c211fe801775c67'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.566372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792583-29f3-47fb-a144-5a5f4d3c3c63 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.566961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792583-29f3-47fb-a144-5a5f4d3c3c63 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.567309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792583-29f3-47fb-a144-5a5f4d3c3c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.570371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8cf2e448834adc8c211fe801775c67'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.580646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8cf2e448834adc8c211fe801775c67'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.589437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e9792583-29f3-47fb-a144-5a5f4d3c3c63 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:28.590814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e9792583-29f3-47fb-a144-5a5f4d3c3c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:28.599602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df89f2dc-93d3-4867-916e-cdde4c5677cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8cf2e448834adc8c211fe801775c67'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:28.602935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 992/1982] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:28.606673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 991/1983] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:28 2022] DELETE /identity/v3/users/9f8cf2e448834adc8c211fe801775c67 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:28.610594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792583-29f3-47fb-a144-5a5f4d3c3c63 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:28.611441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.613699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.613699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.621895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792583-29f3-47fb-a144-5a5f4d3c3c63 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:28.639893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:28.642215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:28.686042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:28.701747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:28.702627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.703070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.704048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.704711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:28.705253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:28.707984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:28.718776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 992/1984] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:28.724867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 993/1985] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:28.733129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:28.733285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:28.734556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:28.734789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:28.754330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc2459-0053-4ad8-a85e-4dc312ef3cdc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:28.760497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:28.761268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.761553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.761948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.762625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:28.765201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:28.782223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:28.815202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 993/1986] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:28 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:28.816633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:28.823830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5474f1-a718-4a9b-bd0c-858542898d4b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:28.895793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:28.896520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.896807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.897087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.909147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947eb5f-0791-453f-ab29-a743b07f0dc4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:28.910077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:28.912322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:28.915611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:28.916310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.916658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.917058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.917883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:28.921583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:28.927807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 994/1987] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:28.954261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 994/1988] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:28 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:28.959936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:28.974197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4717-c707-4d75-8464-4975a59fe04c service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:28.982819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:28.983753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:28.984364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:28.984656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:28.985414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:28.987460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:29.007278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 995/1989] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:29.008224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:29.026372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf850ab-3b1e-492d-ab81-8f6bf1f96657 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:29.038138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d86f7f-1396-4c02-b786-148340bae5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:29.038873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d86f7f-1396-4c02-b786-148340bae5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:29.039093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d86f7f-1396-4c02-b786-148340bae5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:29.039363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d86f7f-1396-4c02-b786-148340bae5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:29.040623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d86f7f-1396-4c02-b786-148340bae5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:29.042385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d86f7f-1396-4c02-b786-148340bae5a4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:29.066557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 995/1990] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:29.070304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:29.085974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cde36-ced1-4553-8b50-ad3e9ff6c133 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:29.095525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:29.096861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:29.097218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:29.097571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] PATH_INFO: `/v3/projects/ed1267fd261f4d9b91ecd45eafaac475/users/b9950a981c7f4cf6b4f352a880a532c4/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:29.125337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1267fd261f4d9b91ecd45eafaac475, user_id=b9950a981c7f4cf6b4f352a880a532c4, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:29.128616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:29.165914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 996/1991] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:29 2022] PUT /identity/v3/projects/ed1267fd261f4d9b91ecd45eafaac475/users/b9950a981c7f4cf6b4f352a880a532c4/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:29.181393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:29.181690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:29.182084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:29.236922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] MFA Rules not processed for user `b9950a981c7f4cf6b4f352a880a532c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:29.238167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:29.341853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 996/1992] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:29.347087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:29.429672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:29.431247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:29.487941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13667db-9ed9-4497-8ceb-1773f907cabc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:29.501156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:29.501753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:29.502663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:29.503097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:29.503524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:29.504630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:29.507966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:29.568536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 997/1993] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:29 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:29.591137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:29.603976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc204a-7a6f-4fee-b843-0f15a794e138 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:29.694472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:29.696697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:29.696697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:29.696697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] PATH_INFO: `/v3/projects/ab29f2add50c49a88983c4065b962aa3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:29.697591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab29f2add50c49a88983c4065b962aa3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:29.699751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:29.729346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:29.776185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab29f2add50c49a88983c4065b962aa3', 'request_id': 'req-6c515506-7cb1-40c5-b736-bb2369622c75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:29.781802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16575-9e7e-4cee-8583-7a80e3a1bc26 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:29.785174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab29f2add50c49a88983c4065b962aa3', 'request_id': 'req-6c515506-7cb1-40c5-b736-bb2369622c75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:29.796328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab29f2add50c49a88983c4065b962aa3', 'request_id': 'req-6c515506-7cb1-40c5-b736-bb2369622c75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:29.817644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] The token cache is being invalidate because project ab29f2add50c49a88983c4065b962aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:29.818430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:29.819169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:29.825447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 997/1994] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:29 2022] DELETE /identity/v3/projects/ab29f2add50c49a88983c4065b962aa3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:29.834256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:29.837258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:29.979311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:29.979949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:29.980234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:29.980515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:29.981699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:29.984434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.013164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 998/1995] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:29 2022] POST /identity/v3/users => generated 300 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:30.014219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515506-7cb1-40c5-b736-bb2369622c75 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:30.014377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:30.017023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:30.022807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:30.023708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.024352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.024741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] PATH_INFO: `/v3/users/fa0c0c3b8a62469bb4dabf3942741ac9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.027707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0c0c3b8a62469bb4dabf3942741ac9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:30.031200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.035631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:30.038627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c352-94ee-403e-ba5d-9d2008143196 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:30.052392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:30.053860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.054382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.055296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.057071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:30.060508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.087028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 999/1996] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:30.092014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:30.112827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0c0c3b8a62469bb4dabf3942741ac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.113638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0c0c3b8a62469bb4dabf3942741ac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.118814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2430-3c65-4ea5-8919-4f6b7f6436f1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:30.122908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0c0c3b8a62469bb4dabf3942741ac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.126490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:30.128405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.128835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.129173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] PATH_INFO: `/v3/projects/227ad06ef094415cb217fa4e0715ae56/users/b84de71825fb44df890a8ae1756ddcb2/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.137232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0c0c3b8a62469bb4dabf3942741ac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.160397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227ad06ef094415cb217fa4e0715ae56, user_id=b84de71825fb44df890a8ae1756ddcb2, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:30.163288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.181155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0c0c3b8a62469bb4dabf3942741ac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.196847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 998/1997] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:29 2022] DELETE /identity/v3/users/fa0c0c3b8a62469bb4dabf3942741ac9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:30.197033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1000/1998] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:30 2022] PUT /identity/v3/projects/227ad06ef094415cb217fa4e0715ae56/users/b84de71825fb44df890a8ae1756ddcb2/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:30.200976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:30.202921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:30.352712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969653b-1fb8-4d58-86f3-5201c932defa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:30.365399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c847-c0be-409a-b509-3e1828fb3fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:30.367315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c847-c0be-409a-b509-3e1828fb3fae admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.368279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c847-c0be-409a-b509-3e1828fb3fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.369173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c847-c0be-409a-b509-3e1828fb3fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.369979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c847-c0be-409a-b509-3e1828fb3fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:30.385931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c847-c0be-409a-b509-3e1828fb3fae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.406901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 999/1999] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:30.408879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:30.538061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961a9d-8074-4c35-adc2-04d3a25b9566 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:30.543626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:30.544950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.545359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.545735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] PATH_INFO: `/v3/projects/227ad06ef094415cb217fa4e0715ae56/users/b84de71825fb44df890a8ae1756ddcb2/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.549682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227ad06ef094415cb217fa4e0715ae56, user_id=b84de71825fb44df890a8ae1756ddcb2, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:30.553510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.577163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1001/2000] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:30 2022] PUT /identity/v3/projects/227ad06ef094415cb217fa4e0715ae56/users/b84de71825fb44df890a8ae1756ddcb2/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:30.579426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.579842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.580878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.627607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] MFA Rules not processed for user `b84de71825fb44df890a8ae1756ddcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:30.629047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:30.697580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:30.699871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:30.771694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:30.776406 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1000/2001] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:30.792514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:30.794054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:30.800642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:30.807816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375734f-4634-4b7b-a625-fbf06c7adc91 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:30.813359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:30.814362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.815596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.815998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] PATH_INFO: `/v3/projects/a94f3df048ef4994a57e211d347b14f6` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.817618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94f3df048ef4994a57e211d347b14f6)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:30.819640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.864545 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6099588-0322-4084-ab9a-ca62c7af479b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:30.869057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe443f-bf0c-41d9-8efe-439986fb6a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:30.869676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe443f-bf0c-41d9-8efe-439986fb6a14 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.869991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe443f-bf0c-41d9-8efe-439986fb6a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.870434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe443f-bf0c-41d9-8efe-439986fb6a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.883455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe443f-bf0c-41d9-8efe-439986fb6a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:30.885357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe443f-bf0c-41d9-8efe-439986fb6a14 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:30.885902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94f3df048ef4994a57e211d347b14f6', 'request_id': 'req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.894245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94f3df048ef4994a57e211d347b14f6', 'request_id': 'req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.896744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1001/2002] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:30.903664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94f3df048ef4994a57e211d347b14f6', 'request_id': 'req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.925089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] The token cache is being invalidate because project a94f3df048ef4994a57e211d347b14f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:30.925394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.926267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7a019c05-30c4-4af1-b4fa-22c8d7b9ba5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:30.930509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1002/2003] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:30 2022] DELETE /identity/v3/projects/a94f3df048ef4994a57e211d347b14f6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:30.932995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c32bca-495d-47b0-ac5e-4363c6e8d0ea None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:30.933293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c32bca-495d-47b0-ac5e-4363c6e8d0ea None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:30.933575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c32bca-495d-47b0-ac5e-4363c6e8d0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:30.960115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f5c32bca-495d-47b0-ac5e-4363c6e8d0ea None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:30.961348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f5c32bca-495d-47b0-ac5e-4363c6e8d0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:31.056039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1002/2004] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:31.065040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0e53-2437-4582-b230-36a95acf3668 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.065277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0e53-2437-4582-b230-36a95acf3668 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.065530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0e53-2437-4582-b230-36a95acf3668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.090763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f10d0e53-2437-4582-b230-36a95acf3668 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:31.090763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f10d0e53-2437-4582-b230-36a95acf3668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:31.101372 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1003/2005] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:31.102861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c32bca-495d-47b0-ac5e-4363c6e8d0ea None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.119456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c32bca-495d-47b0-ac5e-4363c6e8d0ea None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.125531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.126264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.126682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.127455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.127865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:31.128355 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.129966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.150710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1003/2006] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:36:31.155666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0e53-2437-4582-b230-36a95acf3668 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.167204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0e53-2437-4582-b230-36a95acf3668 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.179688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.180421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.180697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.180971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.181612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.183655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.227280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1004/2007] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:31 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:31.227396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.236807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d35a-ad79-45df-b03f-f2f0df8bebe6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.265009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.267051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:31.364449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.365814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.366109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.366683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.368095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.371556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.411634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0640b-9bf9-4cd9-9db4-e730c1ff3818 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.415033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1004/2008] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:31 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:31.417690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.418455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.418740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.419016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] PATH_INFO: `/v3/users/b9950a981c7f4cf6b4f352a880a532c4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.419189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.420163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9950a981c7f4cf6b4f352a880a532c4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.422574 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.435224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abaa29-74ff-4a15-8e2f-e98ecf4e3da4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.442000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.442778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.443217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.443719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.444953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.448524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.461707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1005/2009] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:31.466008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.478382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec9fe3-1c78-49b2-b88b-3ca37379d0be admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.484231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.485232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.485692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.486937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.487863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.489654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.496173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:31.506191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1006/2010] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:31.506415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:31.508657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.530170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9950a981c7f4cf6b4f352a880a532c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:31.541876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce05b-5a92-4ef7-9b13-bbe51a07d3e6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.550656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9950a981c7f4cf6b4f352a880a532c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:31.551745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9950a981c7f4cf6b4f352a880a532c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:31.552640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9950a981c7f4cf6b4f352a880a532c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:31.555712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044c40f-cb00-472c-bb28-61a2d7d972b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.556472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044c40f-cb00-472c-bb28-61a2d7d972b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.556788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044c40f-cb00-472c-bb28-61a2d7d972b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.557250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044c40f-cb00-472c-bb28-61a2d7d972b3 admin admin] PATH_INFO: `/v3/projects/77a22f9463c74ced8eedd05848feb3c3/users/79a70505653c485ba4807872edbf828b/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.575898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bf2dbdda-6bca-4d31-9c1f-a50c6296cc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9950a981c7f4cf6b4f352a880a532c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:31.590174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044c40f-cb00-472c-bb28-61a2d7d972b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a22f9463c74ced8eedd05848feb3c3, user_id=79a70505653c485ba4807872edbf828b, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.592922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044c40f-cb00-472c-bb28-61a2d7d972b3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.612962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1007/2011] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:31 2022] PUT /identity/v3/projects/77a22f9463c74ced8eedd05848feb3c3/users/79a70505653c485ba4807872edbf828b/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:31.618757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1005/2012] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:31 2022] DELETE /identity/v3/users/b9950a981c7f4cf6b4f352a880a532c4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:31.624352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.624744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.624919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.628675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.629165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.629734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.661555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] MFA Rules not processed for user `79a70505653c485ba4807872edbf828b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:31.663754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:31.673397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:31.677320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:31.761200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1006/2013] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:31.771412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.773557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:31.776693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1008/2014] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:31.783841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.788140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:31.819642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d374c-2f38-441c-ad27-53f0121fab24 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.827621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.828336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.828683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.829027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.829808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:31.832182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:31.875584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de32dee-7471-495c-ba6a-5eb0b4718ed6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:31.884704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1009/2015] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:31 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:31.885490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:31.948933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:31.949737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:31.950126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:31.950532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:31.993539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:32.018608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5343b5-116c-4766-9489-47b307795f8a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.024389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.025383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.025853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.026598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.027778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.029997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.045211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.046976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.053732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1010/2016] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:31 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:32.057546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.058014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1007/2017] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:32.073134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3aa8f-4464-4ec5-bd6b-590607af9102 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.080690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.081245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.081531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.081802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.082696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.084576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.098234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1011/2018] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:32.104797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.129851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c066-f926-40d9-8c8a-c1c929d7c21a service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.138851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.139748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.140168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.140409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] PATH_INFO: `/v3/projects/bd2e10362c1c4e46812d37b820f9a395/users/862ff6b082de422385ddecbdc9056723/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.162381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2e10362c1c4e46812d37b820f9a395, user_id=862ff6b082de422385ddecbdc9056723, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.165813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.184854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1008/2019] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:32 2022] PUT /identity/v3/projects/bd2e10362c1c4e46812d37b820f9a395/users/862ff6b082de422385ddecbdc9056723/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:32.188655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.208554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12819ec-fda0-4b14-ab85-16f6072240b2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.228931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:32.302098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c767-daa0-4d84-ab6e-44f9f92fa00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.302966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c767-daa0-4d84-ab6e-44f9f92fa00c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.303316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c767-daa0-4d84-ab6e-44f9f92fa00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.303921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c767-daa0-4d84-ab6e-44f9f92fa00c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.304718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c767-daa0-4d84-ab6e-44f9f92fa00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.306270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c767-daa0-4d84-ab6e-44f9f92fa00c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.319140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1012/2020] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:32.323535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.334406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b5f-72b1-4cf3-88d8-08f91d6cd6e2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.339590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.340260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.340923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.340923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] PATH_INFO: `/v3/projects/bd2e10362c1c4e46812d37b820f9a395/users/862ff6b082de422385ddecbdc9056723/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.343530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2e10362c1c4e46812d37b820f9a395, user_id=862ff6b082de422385ddecbdc9056723, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.346267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.356761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1009/2021] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:32 2022] PUT /identity/v3/projects/bd2e10362c1c4e46812d37b820f9a395/users/862ff6b082de422385ddecbdc9056723/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:32.367834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.368506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.368506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.389232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.391232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:32.401566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] MFA Rules not processed for user `862ff6b082de422385ddecbdc9056723`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:32.402936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:32.498778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a425-9b98-4d5e-b21d-d3cf689e1f0e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.500775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1013/2022] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:32.504482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.505293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.505648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.506130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] PATH_INFO: `/v3/projects/ed1267fd261f4d9b91ecd45eafaac475` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.507794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1267fd261f4d9b91ecd45eafaac475)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.509572 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.513377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.514883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:32.584606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1267fd261f4d9b91ecd45eafaac475', 'request_id': 'req-ee605b69-2b35-4cc0-8f84-f383a9fbe501'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.593016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1267fd261f4d9b91ecd45eafaac475', 'request_id': 'req-ee605b69-2b35-4cc0-8f84-f383a9fbe501'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.601579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1267fd261f4d9b91ecd45eafaac475', 'request_id': 'req-ee605b69-2b35-4cc0-8f84-f383a9fbe501'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.612072 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e84344-802f-4c34-979c-978587ecf287 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.614480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] The token cache is being invalidate because project ed1267fd261f4d9b91ecd45eafaac475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:32.614823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.615578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.618404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1010/2023] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:32 2022] DELETE /identity/v3/projects/ed1267fd261f4d9b91ecd45eafaac475 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:32.622104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.623650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:32.650621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:32.674846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.675891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.676107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.676314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.678135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:32.702534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:32.720158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee605b69-2b35-4cc0-8f84-f383a9fbe501 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.726407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.727088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.727347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.727629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] PATH_INFO: `/v3/users/b84de71825fb44df890a8ae1756ddcb2` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.728799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84de71825fb44df890a8ae1756ddcb2)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.730810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.772214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.773688 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.784520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1014/2024] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:32.794263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84de71825fb44df890a8ae1756ddcb2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.804748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84de71825fb44df890a8ae1756ddcb2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.805570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84de71825fb44df890a8ae1756ddcb2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.813541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84de71825fb44df890a8ae1756ddcb2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.814794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:32.817825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:32.819446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7c480cdf-6792-492e-9549-649782a7459c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84de71825fb44df890a8ae1756ddcb2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.840089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8c6c-4991-4c68-83e8-8df34f35a544 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:32.845487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:32.846326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:32.846712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:32.848881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] PATH_INFO: `/v3/users/79a70505653c485ba4807872edbf828b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:32.850719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1011/2025] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:32 2022] DELETE /identity/v3/users/b84de71825fb44df890a8ae1756ddcb2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:32.851262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a70505653c485ba4807872edbf828b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:32.866907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:32.944627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a70505653c485ba4807872edbf828b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.945438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a70505653c485ba4807872edbf828b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.958069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a70505653c485ba4807872edbf828b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.967360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a70505653c485ba4807872edbf828b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:32.988483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a70505653c485ba4807872edbf828b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.000059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1015/2026] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:32 2022] DELETE /identity/v3/users/79a70505653c485ba4807872edbf828b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:33.005255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.005580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.006042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.045509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:33.046955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.188984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1012/2027] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:33.203027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:33.205719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.324847 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:33.325942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42f487-9e12-40b7-b068-d525524a9dd9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:33.326307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.330941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:33.331667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.332314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.332704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.354943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4164-c3f9-4a70-abb4-cfab4407e132 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:33.374666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:33.376277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.377221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.377774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] PATH_INFO: `/v3/projects/227ad06ef094415cb217fa4e0715ae56` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.379460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:33.382713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:33.383234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227ad06ef094415cb217fa4e0715ae56)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:33.386497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:33.400089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1016/2028] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:33.453263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:33.479755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227ad06ef094415cb217fa4e0715ae56', 'request_id': 'req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.490480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:33.490826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227ad06ef094415cb217fa4e0715ae56', 'request_id': 'req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.493045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.503284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227ad06ef094415cb217fa4e0715ae56', 'request_id': 'req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.519066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca044-37c8-41a2-996d-da56bcf0457f service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:33.520514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] The token cache is being invalidate because project 227ad06ef094415cb217fa4e0715ae56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:33.520812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.521486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a27bb6e0-bdbb-4979-8e41-0e773e0bd261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.523504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1013/2029] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:33 2022] DELETE /identity/v3/projects/227ad06ef094415cb217fa4e0715ae56 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:33.528615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9891981-d4fb-42da-8d99-943c358ba697 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.528900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9891981-d4fb-42da-8d99-943c358ba697 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.529279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9891981-d4fb-42da-8d99-943c358ba697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.555772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:33.562012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d9891981-d4fb-42da-8d99-943c358ba697 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:33.563322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d9891981-d4fb-42da-8d99-943c358ba697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.620533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:33.621207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.621488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.621777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] PATH_INFO: `/v3/users/bdcbf0a7d4914f29b3d1287d018563ad` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.623529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdcbf0a7d4914f29b3d1287d018563ad)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:33.628403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:33.650822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1014/2030] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:33.658793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5ea3-ed04-4576-bc87-70772ecdafa1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.659147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5ea3-ed04-4576-bc87-70772ecdafa1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.659538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5ea3-ed04-4576-bc87-70772ecdafa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.683742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-20ef5ea3-ed04-4576-bc87-70772ecdafa1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:33.685041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-20ef5ea3-ed04-4576-bc87-70772ecdafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.700616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1015/2031] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:33.701790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5ea3-ed04-4576-bc87-70772ecdafa1 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:33.715377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5ea3-ed04-4576-bc87-70772ecdafa1 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:33.724466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:33.726044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.726606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.727113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.728023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:33.728813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:33.730287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:33.747588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1016/2032] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:33.754757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:33.786176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4efd4-5c09-4e45-8c9e-a3bcd2f6047a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:33.790874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdcbf0a7d4914f29b3d1287d018563ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.791500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:33.791624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdcbf0a7d4914f29b3d1287d018563ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.792127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.792411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.794386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.794386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:33.795619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:33.806057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdcbf0a7d4914f29b3d1287d018563ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.814808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdcbf0a7d4914f29b3d1287d018563ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.833669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdcbf0a7d4914f29b3d1287d018563ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:33.839852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1017/2033] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:33 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:33.841358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:33.845224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.853071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1017/2034] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:33 2022] DELETE /identity/v3/users/bdcbf0a7d4914f29b3d1287d018563ad => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:33.854734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:33.858828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:33.953182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd201e0d-2da5-424b-bf09-2a1e5db9362e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:33.976830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dce7c-4dc2-479c-9e47-ae11da22b28d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:33.983581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9e473-b28b-4c0b-8bb9-16d70aee7a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:33.984295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9e473-b28b-4c0b-8bb9-16d70aee7a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:33.984643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9e473-b28b-4c0b-8bb9-16d70aee7a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:33.984990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9e473-b28b-4c0b-8bb9-16d70aee7a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:33.985851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9e473-b28b-4c0b-8bb9-16d70aee7a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:33.988980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9e473-b28b-4c0b-8bb9-16d70aee7a64 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:33.989954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:34.017344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1018/2035] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:33 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:34.017344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5d3b4-36b5-4f7c-8e7b-b0ef33052573 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.017344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5d3b4-36b5-4f7c-8e7b-b0ef33052573 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.017344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5d3b4-36b5-4f7c-8e7b-b0ef33052573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.036947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e2c5d3b4-36b5-4f7c-8e7b-b0ef33052573 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:34.037253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:34.037901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.038182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.038291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e2c5d3b4-36b5-4f7c-8e7b-b0ef33052573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.038493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] PATH_INFO: `/v3/projects/77a22f9463c74ced8eedd05848feb3c3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.039627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a22f9463c74ced8eedd05848feb3c3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:34.041544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:34.046216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1019/2036] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:34.051092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5d3b4-36b5-4f7c-8e7b-b0ef33052573 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.060660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5d3b4-36b5-4f7c-8e7b-b0ef33052573 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:34.065412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:34.066007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.066283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.066587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.067220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:34.068986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:34.079922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1020/2037] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:34.080810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.082650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.093968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a22f9463c74ced8eedd05848feb3c3', 'request_id': 'req-5e2c6425-0c25-4b48-8869-a811cbcf12c2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.101155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a22f9463c74ced8eedd05848feb3c3', 'request_id': 'req-5e2c6425-0c25-4b48-8869-a811cbcf12c2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.101360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:34.114815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a22f9463c74ced8eedd05848feb3c3', 'request_id': 'req-5e2c6425-0c25-4b48-8869-a811cbcf12c2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.128611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] The token cache is being invalidate because project 77a22f9463c74ced8eedd05848feb3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:34.129195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.129982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.132233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1018/2038] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:33 2022] DELETE /identity/v3/projects/77a22f9463c74ced8eedd05848feb3c3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:34.133431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.145498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.177359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da776-4eaa-41f0-8ffa-5b7b27627d11 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:34.231639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6425-0c25-4b48-8869-a811cbcf12c2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:34.237257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:34.237887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.238172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.238411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:34.238526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.239041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.239139 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:34.239399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.239859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.240740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:34.241860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.253098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1019/2039] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:34.257150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.259006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.259852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:34.261550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:34.281437 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1021/2040] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:34.282650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.289149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743c76f-6008-4a2f-ad44-1b125081e525 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:34.293309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1624087-fadb-4b72-a9a4-5385fbb3bf1c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:34.295665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:34.296392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.296773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.297156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] PATH_INFO: `/v3/users/862ff6b082de422385ddecbdc9056723` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.298232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91935c5-0f14-47b7-afcc-1396bb34c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:34.298367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862ff6b082de422385ddecbdc9056723)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:34.299269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91935c5-0f14-47b7-afcc-1396bb34c988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.299617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91935c5-0f14-47b7-afcc-1396bb34c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.299965 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91935c5-0f14-47b7-afcc-1396bb34c988 admin admin] PATH_INFO: `/v3/projects/d9e5f43476be401198770a2b59bed316/users/c7a5da5956794dab89c6c75a8dd1ac61/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.300482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:34.320768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91935c5-0f14-47b7-afcc-1396bb34c988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e5f43476be401198770a2b59bed316, user_id=c7a5da5956794dab89c6c75a8dd1ac61, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:34.323914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91935c5-0f14-47b7-afcc-1396bb34c988 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:34.340999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1022/2041] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:34 2022] PUT /identity/v3/projects/d9e5f43476be401198770a2b59bed316/users/c7a5da5956794dab89c6c75a8dd1ac61/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:34.353271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.353604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.354098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.373893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:34.382011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862ff6b082de422385ddecbdc9056723'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.398053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862ff6b082de422385ddecbdc9056723'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.398947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862ff6b082de422385ddecbdc9056723'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.399648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862ff6b082de422385ddecbdc9056723'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.409036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] MFA Rules not processed for user `c7a5da5956794dab89c6c75a8dd1ac61`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:34.409738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862ff6b082de422385ddecbdc9056723'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:34.410651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.437985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1020/2042] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:34 2022] DELETE /identity/v3/users/862ff6b082de422385ddecbdc9056723 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:34.506055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1023/2043] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:34.553427 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.555104 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.678172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6eefe-a7ff-4db0-9d72-f4be78151568 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:34.690183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:34.690849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:34.691145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:34.691399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:34.716064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.717539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.819995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:34.823099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:34.834202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:34.849888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1021/2044] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:34.882674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:34.884134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:34.903550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54621446-3d4e-4002-a3a3-5f36e891e5d3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.039873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.040490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.040976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.041185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] PATH_INFO: `/v3/projects/aa5008c7a0404918b175e7cddae98969` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.043271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e4661-0bcf-402f-8962-bedc79d2b01c service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.043390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5008c7a0404918b175e7cddae98969)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.045265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.051004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.051904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.052272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.052948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] PATH_INFO: `/v3/users/c7a5da5956794dab89c6c75a8dd1ac61` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.054327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a5da5956794dab89c6c75a8dd1ac61)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.057080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.084977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:35.139135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5008c7a0404918b175e7cddae98969', 'request_id': 'req-25997be2-2baa-4c84-b3b5-19e0a897d597'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.141189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a5da5956794dab89c6c75a8dd1ac61'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.147706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5008c7a0404918b175e7cddae98969', 'request_id': 'req-25997be2-2baa-4c84-b3b5-19e0a897d597'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.153598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a5da5956794dab89c6c75a8dd1ac61'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.154773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a5da5956794dab89c6c75a8dd1ac61'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.155950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a5da5956794dab89c6c75a8dd1ac61'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.159124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5008c7a0404918b175e7cddae98969', 'request_id': 'req-25997be2-2baa-4c84-b3b5-19e0a897d597'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.169583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a5da5956794dab89c6c75a8dd1ac61'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.191552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] The token cache is being invalidate because project aa5008c7a0404918b175e7cddae98969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:35.191975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.193105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1022/2045] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:34 2022] DELETE /identity/v3/users/c7a5da5956794dab89c6c75a8dd1ac61 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:35.194436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:35.196237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.196784 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-25997be2-2baa-4c84-b3b5-19e0a897d597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.198871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1024/2046] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:34 2022] DELETE /identity/v3/projects/aa5008c7a0404918b175e7cddae98969 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:35.201702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.201702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.201702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.234837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:35.236706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.287129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22c20b-6972-4fc9-9f28-fa212ae5e19e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.291879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.292519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.292800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.293078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] PATH_INFO: `/v3/projects/bd2e10362c1c4e46812d37b820f9a395` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.294204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2e10362c1c4e46812d37b820f9a395)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.296163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.303360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1025/2047] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:35.304217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:35.305503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.317451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857315ff-eba6-4f0d-85cc-61005f20db09 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.323244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.323549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.324045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.324151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] PATH_INFO: `/v3/users/6141d85c4433422fabb73181d4309ef5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.325378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6141d85c4433422fabb73181d4309ef5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.327331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.342127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:35.352456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2e10362c1c4e46812d37b820f9a395', 'request_id': 'req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.359999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2e10362c1c4e46812d37b820f9a395', 'request_id': 'req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.368014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2e10362c1c4e46812d37b820f9a395', 'request_id': 'req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.380334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6141d85c4433422fabb73181d4309ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.381111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6141d85c4433422fabb73181d4309ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.381240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] The token cache is being invalidate because project bd2e10362c1c4e46812d37b820f9a395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:35.381443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.382129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.384201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1023/2048] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:35 2022] DELETE /identity/v3/projects/bd2e10362c1c4e46812d37b820f9a395 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:35.384663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:35.386027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.390845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6141d85c4433422fabb73181d4309ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.399809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6141d85c4433422fabb73181d4309ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.414611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d7f6e7a-290f-460e-813e-832eec284ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6141d85c4433422fabb73181d4309ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:35.416108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:35.422427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1026/2049] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:35 2022] DELETE /identity/v3/users/6141d85c4433422fabb73181d4309ef5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:35.427180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458f42c-8338-4622-90a8-5a3175063c6c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.427476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458f42c-8338-4622-90a8-5a3175063c6c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.427761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458f42c-8338-4622-90a8-5a3175063c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.453195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd0c50-3fa0-4b3b-b3cb-d0306b9ea474 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.459458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e458f42c-8338-4622-90a8-5a3175063c6c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:35.460787 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e458f42c-8338-4622-90a8-5a3175063c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.542251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.543774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.543955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.544260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.546639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1027/2050] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:35.553467 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff4ad-6013-4e46-a13d-d9a04fbe21d6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.554484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.556018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff4ad-6013-4e46-a13d-d9a04fbe21d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.556308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff4ad-6013-4e46-a13d-d9a04fbe21d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.582596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-404ff4ad-6013-4e46-a13d-d9a04fbe21d6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:35.584774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-404ff4ad-6013-4e46-a13d-d9a04fbe21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.593583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.596735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.614330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1028/2051] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:35.619089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1024/2052] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:35.619937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff4ad-6013-4e46-a13d-d9a04fbe21d6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:35.636963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff4ad-6013-4e46-a13d-d9a04fbe21d6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.649081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.649635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.649917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.650187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.650895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:35.651197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.652813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.666161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1029/2053] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:35.670800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:35.681981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f176-118a-40f0-abd0-f5cc3fa2f14e service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.688152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.688730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.689097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.692356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.692356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.694768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.748028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1025/2054] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:35 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:35.749528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:35.763813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515b950-24a0-40ea-af87-2d4ea3720a80 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.807471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:35.809239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:35.962276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.963106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.963556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.963637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220c464-3522-4443-81cd-daac4f0ec10b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:35.963728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.964443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.966794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.991230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:35.992155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:35.992610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:35.992714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:35.993150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] PATH_INFO: `/v3/projects/5298f691119b407bbab617cf9a8b2e7d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:35.994565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5298f691119b407bbab617cf9a8b2e7d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:35.997908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:35.998709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1030/2055] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:35 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:35.999710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.005430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:36.048561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324e7ef-a1be-4961-bfa8-6bb162c3c87f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.065436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.066524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.066877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.068927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] PATH_INFO: `/v3/projects/d9e5f43476be401198770a2b59bed316` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.071182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e5f43476be401198770a2b59bed316)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.073426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.079550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5298f691119b407bbab617cf9a8b2e7d', 'request_id': 'req-b17208b1-7874-4fbd-8fa9-ae12780837e2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.090144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5298f691119b407bbab617cf9a8b2e7d', 'request_id': 'req-b17208b1-7874-4fbd-8fa9-ae12780837e2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.101088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5298f691119b407bbab617cf9a8b2e7d', 'request_id': 'req-b17208b1-7874-4fbd-8fa9-ae12780837e2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.104011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:36.126771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] The token cache is being invalidate because project 5298f691119b407bbab617cf9a8b2e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:36.127631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.129807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.133720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1026/2056] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:35 2022] DELETE /identity/v3/projects/5298f691119b407bbab617cf9a8b2e7d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:36.134507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.143347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:36.146060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e5f43476be401198770a2b59bed316', 'request_id': 'req-856b8100-fcd9-4250-b41b-974e1cac7e2f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.153767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e5f43476be401198770a2b59bed316', 'request_id': 'req-856b8100-fcd9-4250-b41b-974e1cac7e2f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.166969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e5f43476be401198770a2b59bed316', 'request_id': 'req-856b8100-fcd9-4250-b41b-974e1cac7e2f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.181869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] The token cache is being invalidate because project d9e5f43476be401198770a2b59bed316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:36.182256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.183419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-856b8100-fcd9-4250-b41b-974e1cac7e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:36.185203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1031/2057] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:35 2022] DELETE /identity/v3/projects/d9e5f43476be401198770a2b59bed316 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:36.186628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fbdb-9335-43c9-b357-d77dd29f7aef None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.187502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fbdb-9335-43c9-b357-d77dd29f7aef None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.187785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fbdb-9335-43c9-b357-d77dd29f7aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.212045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c8a0fbdb-9335-43c9-b357-d77dd29f7aef None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:36.213314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8a0fbdb-9335-43c9-b357-d77dd29f7aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:36.229354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17208b1-7874-4fbd-8fa9-ae12780837e2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.410629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.411173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.411453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.411728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.412435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.414045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.438199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1027/2058] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:36.443260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.451863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:36.466491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1032/2059] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:36.478416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c77b1-1ac3-42bb-b8b2-5d64ca2f3163 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.478814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c77b1-1ac3-42bb-b8b2-5d64ca2f3163 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.479444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c77b1-1ac3-42bb-b8b2-5d64ca2f3163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.481581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a923c7-6242-4737-8a62-688cbacfbbc6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.490612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.491685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.492120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.492619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.493654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.498495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.530763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1028/2060] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:36.530763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.535359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-629c77b1-1ac3-42bb-b8b2-5d64ca2f3163 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:36.535359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-629c77b1-1ac3-42bb-b8b2-5d64ca2f3163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:36.549179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1033/2061] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:36.553841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c77b1-1ac3-42bb-b8b2-5d64ca2f3163 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.557143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe2e5-710c-4118-aa73-173350ab723a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.562155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.562868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.563154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.563432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] PATH_INFO: `/v3/projects/e43b2f2da23d4885ba070728e356a83f/users/d3a58460cdb543d6b3c49823d9317928/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.576847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c77b1-1ac3-42bb-b8b2-5d64ca2f3163 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.585245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43b2f2da23d4885ba070728e356a83f, user_id=d3a58460cdb543d6b3c49823d9317928, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.588210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.597588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449b869-4ff9-458d-a3bd-1732936ddc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.598243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b869-4ff9-458d-a3bd-1732936ddc89 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.598565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b869-4ff9-458d-a3bd-1732936ddc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.598845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b869-4ff9-458d-a3bd-1732936ddc89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.599499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449b869-4ff9-458d-a3bd-1732936ddc89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:36.599808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449b869-4ff9-458d-a3bd-1732936ddc89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.601511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449b869-4ff9-458d-a3bd-1732936ddc89 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.613807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1029/2062] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:36 2022] PUT /identity/v3/projects/e43b2f2da23d4885ba070728e356a83f/users/d3a58460cdb543d6b3c49823d9317928/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:36.617470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1034/2063] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:36.619486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.625458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4536dd5-346e-4101-a1fb-7a3f6e08e540 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.625751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4536dd5-346e-4101-a1fb-7a3f6e08e540 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.626062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4536dd5-346e-4101-a1fb-7a3f6e08e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.655194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c4536dd5-346e-4101-a1fb-7a3f6e08e540 None None] MFA Rules not processed for user `d3a58460cdb543d6b3c49823d9317928`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:36.656526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c4536dd5-346e-4101-a1fb-7a3f6e08e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:36.696683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872e6d5-2571-4344-9cc5-9ea693f1e563 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.701356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.701957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.702235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.702533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.703168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.705099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.709684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:36.715953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:36.730155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1035/2064] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:36.733644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1030/2065] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:36 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:36.734838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4536dd5-346e-4101-a1fb-7a3f6e08e540 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.738073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.746500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4536dd5-346e-4101-a1fb-7a3f6e08e540 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.824756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb47d-391f-4cde-805d-29b892cd5a40 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.831160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.831792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.832057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.832325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.832964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.833068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.833676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.834027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.834387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.835112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.835216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.837520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.863099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1031/2066] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:36 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:36.867522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.882180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1036/2067] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:36 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:36.882403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e7f77-455e-4660-9b26-e50dda58c842 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.883756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.944153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.944889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.945240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.945586 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.946577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.948315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.960791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1750c2-a27f-4ab6-afef-1d0d078b8e7d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.962596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1032/2068] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:36.966024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.966465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:36.966686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.966968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.967300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.967943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.969897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.976974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7248aac-90b5-42dc-817b-d5f55ab219c9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:36.986161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:36.986838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:36.987149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:36.987420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:36.988296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:36.990425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:36.997328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1037/2069] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:36 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:37.005031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1033/2070] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:37.005184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:37.006033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:37.015541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014c465-ee26-4150-adc7-67585bc19a28 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:37.020378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bee74-b73a-4763-911d-ab7135f9afe5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:37.020919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:37.021533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.021813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.022090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.022773 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:37.024368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:37.027367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e605aa3-fb01-4936-8bdf-060de7341bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:37.028137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605aa3-fb01-4936-8bdf-060de7341bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.029046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605aa3-fb01-4936-8bdf-060de7341bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.029450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605aa3-fb01-4936-8bdf-060de7341bd7 admin admin] PATH_INFO: `/v3/projects/5252c94df9d745eeaf07a7c3cea952a9/users/1aa177a7da8e4bd092fbf9015afbcee3/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.035904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1038/2071] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:37.039939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:37.046332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605aa3-fb01-4936-8bdf-060de7341bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5252c94df9d745eeaf07a7c3cea952a9, user_id=1aa177a7da8e4bd092fbf9015afbcee3, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:37.049141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605aa3-fb01-4936-8bdf-060de7341bd7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:37.050739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97c804-b80a-4e16-8399-dc73d93a58fd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:37.062182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:37.063381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.063602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.063886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] PATH_INFO: `/v3/projects/50e0bb18b2094c998bac4bd2e0c577bd/users/f2b2e8d27a4f457d860601f484300ae1/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.070392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1034/2072] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:37 2022] PUT /identity/v3/projects/5252c94df9d745eeaf07a7c3cea952a9/users/1aa177a7da8e4bd092fbf9015afbcee3/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:37.072613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.073058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.073440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.092219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e0bb18b2094c998bac4bd2e0c577bd, user_id=f2b2e8d27a4f457d860601f484300ae1, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:37.094987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:37.096556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:37.097796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:37.117836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1039/2073] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:37 2022] PUT /identity/v3/projects/50e0bb18b2094c998bac4bd2e0c577bd/users/f2b2e8d27a4f457d860601f484300ae1/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:37.132389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:37.161650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:37.176591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:37.208948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1035/2074] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:37.219789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:37.220224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca922d4e-8b41-45af-9ed1-ddbd6a6378b0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:37.221216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:37.226222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:37.226875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.227153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.227431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.228089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:37.229914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:37.242984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1040/2075] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:37.248247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:37.271094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10caddf-28ef-4b0f-8f55-7746901eb20a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:37.279087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaaa43-9070-4d98-b899-d19cfd2ee425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:37.280077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaaa43-9070-4d98-b899-d19cfd2ee425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.280604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaaa43-9070-4d98-b899-d19cfd2ee425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.281758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaaa43-9070-4d98-b899-d19cfd2ee425 admin admin] PATH_INFO: `/v3/projects/50e0bb18b2094c998bac4bd2e0c577bd/users/f2b2e8d27a4f457d860601f484300ae1/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.285080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaaa43-9070-4d98-b899-d19cfd2ee425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e0bb18b2094c998bac4bd2e0c577bd, user_id=f2b2e8d27a4f457d860601f484300ae1, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:37.288594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaaa43-9070-4d98-b899-d19cfd2ee425 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:37.317049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1041/2076] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:37 2022] PUT /identity/v3/projects/50e0bb18b2094c998bac4bd2e0c577bd/users/f2b2e8d27a4f457d860601f484300ae1/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:37.319443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.320464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.320824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.358995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] MFA Rules not processed for user `f2b2e8d27a4f457d860601f484300ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:37.360482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:37.362287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dfe23-018f-43b7-924b-79e2a07048fe None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:37.438796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:37.440605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.441086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.441960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.458793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1042/2077] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:37.472095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:37.474166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:37.577290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:37.579584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:37.580885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc94a4c-40d1-4df1-9bd6-f17e187d11f9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:37.585168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a6f2b-8071-42fe-9313-831176927872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:37.585879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6f2b-8071-42fe-9313-831176927872 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:37.586224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6f2b-8071-42fe-9313-831176927872 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:37.586595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6f2b-8071-42fe-9313-831176927872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:37.605319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1036/2078] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:37.681425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:37.684995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a6f2b-8071-42fe-9313-831176927872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:37.688248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a6f2b-8071-42fe-9313-831176927872 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:37.702690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1043/2079] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:38.389639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:38.391193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:38.408472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01825-5113-47c5-905a-508e419348f9 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:38.413834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:38.414512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:38.414872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:38.415145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] PATH_INFO: `/v3/users/b5452a6fb43246c2a2fc325a869ffbc4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:38.416193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5452a6fb43246c2a2fc325a869ffbc4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:38.418125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:38.464067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:38.475601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5452a6fb43246c2a2fc325a869ffbc4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:38.483297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5452a6fb43246c2a2fc325a869ffbc4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:38.484127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5452a6fb43246c2a2fc325a869ffbc4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:38.484791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5452a6fb43246c2a2fc325a869ffbc4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:38.494971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5452a6fb43246c2a2fc325a869ffbc4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:38.515317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1037/2080] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:38 2022] DELETE /identity/v3/users/b5452a6fb43246c2a2fc325a869ffbc4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:38.520163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ea98-0df8-48a2-8336-753b8f850c38 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:38.520628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ea98-0df8-48a2-8336-753b8f850c38 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:38.520727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ea98-0df8-48a2-8336-753b8f850c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:38.539920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1933ea98-0df8-48a2-8336-753b8f850c38 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:38.541175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1933ea98-0df8-48a2-8336-753b8f850c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:38.614443 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1044/2081] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:38.626043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:38.627758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:38.654461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84924-d0fb-4ed0-aea6-08559e145dc7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:38.655021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84924-d0fb-4ed0-aea6-08559e145dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:38.655494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84924-d0fb-4ed0-aea6-08559e145dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:38.706417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-30e84924-d0fb-4ed0-aea6-08559e145dc7 None None] MFA Rules not processed for user `1aa177a7da8e4bd092fbf9015afbcee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:38.708514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-30e84924-d0fb-4ed0-aea6-08559e145dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:38.762525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5df017-9f27-41bd-bd3a-466c33a23894 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:38.767078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:38.768434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:38.768717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:38.768995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:38.793663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:38.795502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:38.810549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1038/2082] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:38.838154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1045/2083] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:38.840355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:38.842756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:38.862656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0481-f22b-4ad7-a770-70161049dc97 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:38.869408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:38.870156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:38.870540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:38.870894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:38.871610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:38.873726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:38.934754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1039/2084] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:38 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:38.934914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84924-d0fb-4ed0-aea6-08559e145dc7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:38.953277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84924-d0fb-4ed0-aea6-08559e145dc7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.027051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.027668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.027952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.028231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.028891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.030852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.068845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1046/2085] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:38 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:39.072900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:39.087002 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0a6e8-2b0b-49ce-87cd-0fd4faa22d6a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.094213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.094994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.095544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.095931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.098169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.100303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.119226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1040/2086] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:39.123062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:39.145238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3339bb-a963-4466-9369-0e0424213487 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.152055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.153120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.153402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.154204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] PATH_INFO: `/v3/projects/dfa55925f1984d7b9d645e12d61fc45f/users/f7084d664c224e4795ded4ab368e8699/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.173947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:39.178103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa55925f1984d7b9d645e12d61fc45f, user_id=f7084d664c224e4795ded4ab368e8699, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.182142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.197810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:39.199749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:39.223516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ef997-ffb6-4c77-9a8d-a5e27ffaa895 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.224986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1047/2087] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:39 2022] PUT /identity/v3/projects/dfa55925f1984d7b9d645e12d61fc45f/users/f7084d664c224e4795ded4ab368e8699/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:39.229587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:39.312537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.313183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.313505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.313783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] PATH_INFO: `/v3/projects/3d472e6296964df486c5a6145cf0c927` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.315460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d472e6296964df486c5a6145cf0c927)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.317479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.324108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd4514-10b1-4098-9d30-d9ccebe9d9e2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.328960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.329565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.329872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.330705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.331351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.332950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.343294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1048/2088] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:39.347679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:39.349098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:39.350113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:39.367698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d472e6296964df486c5a6145cf0c927', 'request_id': 'req-ff8378c7-273e-4808-8445-29f46b48adcf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.373884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d472e6296964df486c5a6145cf0c927', 'request_id': 'req-ff8378c7-273e-4808-8445-29f46b48adcf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.382450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d472e6296964df486c5a6145cf0c927', 'request_id': 'req-ff8378c7-273e-4808-8445-29f46b48adcf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.395946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] The token cache is being invalidate because project 3d472e6296964df486c5a6145cf0c927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:39.396576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.397025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.398903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1041/2089] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:39 2022] DELETE /identity/v3/projects/3d472e6296964df486c5a6145cf0c927 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:39.399604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:39.401046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:39.416669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059479f-70d5-4769-9396-20d4ba846c97 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.467566 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8378c7-273e-4808-8445-29f46b48adcf admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.468350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.468964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.469243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.469516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.471394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:39.473637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.474304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.474613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.474883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] PATH_INFO: `/v3/projects/dfa55925f1984d7b9d645e12d61fc45f/users/f7084d664c224e4795ded4ab368e8699/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.476876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa55925f1984d7b9d645e12d61fc45f, user_id=f7084d664c224e4795ded4ab368e8699, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.479886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.491071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1042/2090] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:39 2022] PUT /identity/v3/projects/dfa55925f1984d7b9d645e12d61fc45f/users/f7084d664c224e4795ded4ab368e8699/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:39.491969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:39.495878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:39.559675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:39.568261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.572642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.589389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1049/2091] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:39.617438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a752e-4982-4f21-99da-006c80f19922 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:39.625064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:39.625875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:39.626155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:39.626613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] PATH_INFO: `/v3/users/2a0eb3abd2cd4905842c78e43e95252d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:39.628044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0eb3abd2cd4905842c78e43e95252d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:39.630330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:39.713325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0eb3abd2cd4905842c78e43e95252d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.717355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:39.744619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0eb3abd2cd4905842c78e43e95252d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.745813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0eb3abd2cd4905842c78e43e95252d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.746885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0eb3abd2cd4905842c78e43e95252d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.763029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0eb3abd2cd4905842c78e43e95252d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:39.793649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1043/2092] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:39 2022] DELETE /identity/v3/users/2a0eb3abd2cd4905842c78e43e95252d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:40.077691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:40.082013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.112150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33e1e-61b0-46c5-8811-4fab9369555c service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:40.203234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:40.205589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.249314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:40.249314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.249314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.249314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] PATH_INFO: `/v3/users/7307dde5dd494e419466cb475f8dac66` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.251431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7307dde5dd494e419466cb475f8dac66)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:40.260952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:40.320449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99bd2a-70fd-4321-aece-65af0299ce2f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:40.328411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:40.329166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.329451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.329965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] PATH_INFO: `/v3/projects/9cae683bd2a84fdb91b6394c4d6e368e` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.331581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cae683bd2a84fdb91b6394c4d6e368e)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:40.333658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:40.357540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7307dde5dd494e419466cb475f8dac66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.358366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7307dde5dd494e419466cb475f8dac66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.370059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7307dde5dd494e419466cb475f8dac66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.387261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7307dde5dd494e419466cb475f8dac66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.415441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9097a785-2021-49af-9c34-9ba56e331702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7307dde5dd494e419466cb475f8dac66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.439053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1050/2093] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:40 2022] DELETE /identity/v3/users/7307dde5dd494e419466cb475f8dac66 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:40.447656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cae683bd2a84fdb91b6394c4d6e368e', 'request_id': 'req-caea9add-a205-43d1-aa7f-964c4e4ee34a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.448147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e17ce-763e-4618-a139-802db45b3fc8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.448489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e17ce-763e-4618-a139-802db45b3fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.448923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e17ce-763e-4618-a139-802db45b3fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.468559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cae683bd2a84fdb91b6394c4d6e368e', 'request_id': 'req-caea9add-a205-43d1-aa7f-964c4e4ee34a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.480498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cae683bd2a84fdb91b6394c4d6e368e', 'request_id': 'req-caea9add-a205-43d1-aa7f-964c4e4ee34a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.492999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-993e17ce-763e-4618-a139-802db45b3fc8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:40.494404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-993e17ce-763e-4618-a139-802db45b3fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.507119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] The token cache is being invalidate because project 9cae683bd2a84fdb91b6394c4d6e368e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:40.507532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.508230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-caea9add-a205-43d1-aa7f-964c4e4ee34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:40.509841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1044/2094] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:40 2022] DELETE /identity/v3/projects/9cae683bd2a84fdb91b6394c4d6e368e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:40.515896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeaebc-1cd7-4093-9688-53b8352da260 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.516337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeaebc-1cd7-4093-9688-53b8352da260 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.516759 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeaebc-1cd7-4093-9688-53b8352da260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.541261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3adeaebc-1cd7-4093-9688-53b8352da260 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:40.542712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3adeaebc-1cd7-4093-9688-53b8352da260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.607106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:40.621088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1045/2095] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:40.622858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154bbf7-3ecc-4c78-b3ad-d3dd6a014d8a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.623302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154bbf7-3ecc-4c78-b3ad-d3dd6a014d8a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.623763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154bbf7-3ecc-4c78-b3ad-d3dd6a014d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.625133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1051/2096] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:40.630213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.630536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.630990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.653607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:40.654983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.665772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1052/2097] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:40.665947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5154bbf7-3ecc-4c78-b3ad-d3dd6a014d8a None None] MFA Rules not processed for user `f7084d664c224e4795ded4ab368e8699`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:40.667151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5154bbf7-3ecc-4c78-b3ad-d3dd6a014d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.667299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:40.668616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.680879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:40.743880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fd5eb-b145-4bc3-9683-c6878ea8e2c1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:40.747750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4d73-96ba-4495-9bba-6666f5fd422c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:40.748416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4d73-96ba-4495-9bba-6666f5fd422c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.748704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4d73-96ba-4495-9bba-6666f5fd422c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.748984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4d73-96ba-4495-9bba-6666f5fd422c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.762291 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4d73-96ba-4495-9bba-6666f5fd422c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:40.764201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4d73-96ba-4495-9bba-6666f5fd422c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:40.764398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1046/2098] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:40.765446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154bbf7-3ecc-4c78-b3ad-d3dd6a014d8a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:40.776551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1053/2099] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:40.783863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154bbf7-3ecc-4c78-b3ad-d3dd6a014d8a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:40.787524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.788902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:40.789614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.789970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.790314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.791087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:40.791462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:40.793172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:40.793417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.793925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.817837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] MFA Rules not processed for user `1aa177a7da8e4bd092fbf9015afbcee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:40.819105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:40.822770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1047/2100] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:40.827320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:40.843162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce4cf7-53e0-44b5-a52c-6431d9bcd673 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:40.858140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:40.858996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:40.861315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:40.861604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:40.862270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:40.865065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:40.937075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1048/2101] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:40 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:40.940302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:40.953172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1054/2102] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:40.965417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:40.967401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:41.044135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bd215-57d0-4b2d-9e29-58e7d24c2519 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.055251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.055898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.056248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.056449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.057480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.059575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.096820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1049/2103] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:40 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:41.098737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:41.115997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594d71-2dcb-45d7-84a6-5c4f73388503 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.119737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773db2f-6583-4fd4-aade-85f54af7b12b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.125571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.127080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.127515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.127977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.128812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.130717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.150177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1050/2104] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:41.154724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:41.174236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101b774-f897-40ce-ba02-725cc4a08a42 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.182897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.183812 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.184309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.184670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.185519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.188832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.192603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:41.210181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1051/2105] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:41.211593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:41.227527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84811c-fb65-4a1c-944c-0b3769441485 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.233921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.234319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd702-a005-422a-a016-46db3390c432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.234779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.235153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd702-a005-422a-a016-46db3390c432 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.235289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.235542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd702-a005-422a-a016-46db3390c432 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.235650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] PATH_INFO: `/v3/projects/f7c935aff80441eaaf5131a1aabd1fb6/users/9c6baee8002a43a58fd40d43ce373faa/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.236703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd702-a005-422a-a016-46db3390c432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.238862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-83dcd702-a005-422a-a016-46db3390c432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:41.278547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:41.301352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c935aff80441eaaf5131a1aabd1fb6, user_id=9c6baee8002a43a58fd40d43ce373faa, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.304677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.329673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1052/2106] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:41 2022] PUT /identity/v3/projects/f7c935aff80441eaaf5131a1aabd1fb6/users/9c6baee8002a43a58fd40d43ce373faa/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:41.331172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:41.332982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:41.400705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcd702-a005-422a-a016-46db3390c432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.402448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcd702-a005-422a-a016-46db3390c432 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.414917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1055/2107] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:41.416381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9025e2-bbd4-43a7-802a-3a36e9a44542 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.416777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9025e2-bbd4-43a7-802a-3a36e9a44542 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.417330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9025e2-bbd4-43a7-802a-3a36e9a44542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.433780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ecc02-299a-4f5e-b757-3614de2e1ed1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.438843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.439532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.439810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.440084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] PATH_INFO: `/v3/projects/672eb936b1fe4bcbbda46d5c04923052` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.442115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672eb936b1fe4bcbbda46d5c04923052)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.443833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.457198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dd9025e2-bbd4-43a7-802a-3a36e9a44542 None None] MFA Rules not processed for user `9c6baee8002a43a58fd40d43ce373faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:41.458611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dd9025e2-bbd4-43a7-802a-3a36e9a44542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:41.507407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672eb936b1fe4bcbbda46d5c04923052', 'request_id': 'req-b7634e49-ca88-4f5c-88f0-d2963ae306c8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.515528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672eb936b1fe4bcbbda46d5c04923052', 'request_id': 'req-b7634e49-ca88-4f5c-88f0-d2963ae306c8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.529506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672eb936b1fe4bcbbda46d5c04923052', 'request_id': 'req-b7634e49-ca88-4f5c-88f0-d2963ae306c8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.543040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] The token cache is being invalidate because project 672eb936b1fe4bcbbda46d5c04923052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:41.543431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.544508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.547046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1053/2108] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:41 2022] DELETE /identity/v3/projects/672eb936b1fe4bcbbda46d5c04923052 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:41.551898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:41.553609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:41.553746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1056/2109] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:41.559713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9025e2-bbd4-43a7-802a-3a36e9a44542 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:41.575648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9025e2-bbd4-43a7-802a-3a36e9a44542 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.679445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7634e49-ca88-4f5c-88f0-d2963ae306c8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:41.688536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.689878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.690186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.690498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] PATH_INFO: `/v3/users/31baab2dd904410cba8d475eb9c6c59c` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.690897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:41.691787 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:41.691908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31baab2dd904410cba8d475eb9c6c59c)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.692239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:41.692611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:41.693364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:41.694869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.695559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:41.745586 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:41.780405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1057/2110] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:41 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:41.787778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:41.795589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:41.799932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31baab2dd904410cba8d475eb9c6c59c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.811689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31baab2dd904410cba8d475eb9c6c59c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.813763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31baab2dd904410cba8d475eb9c6c59c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.816658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31baab2dd904410cba8d475eb9c6c59c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.816827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:41.851623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31baab2dd904410cba8d475eb9c6c59c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:41.873278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1054/2111] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:41 2022] DELETE /identity/v3/users/31baab2dd904410cba8d475eb9c6c59c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:41.906237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633a9c-7551-4d9e-b0ee-8e30a58c91ac admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:42.019678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:42.020677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.021168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.021599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.022946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:42.025368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:42.060407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1058/2112] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:41 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:42.061850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:42.063873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:42.083075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19925-def2-46ed-b996-9d184c3b9a08 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:42.092033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:42.094510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.095273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.096004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.097916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:42.100307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:42.123572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:42.147892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1055/2113] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:42.179299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa778a1-65a7-42d6-8f32-a1868ba0be6f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:42.199737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:42.200640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.200929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.201213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] PATH_INFO: `/v3/projects/36cf8f64e03a4f7e9b3fba14441bc24a/users/0bae028e34e54ef4bfe4849bd36d5ea4/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.222088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cf8f64e03a4f7e9b3fba14441bc24a, user_id=0bae028e34e54ef4bfe4849bd36d5ea4, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:42.228766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:42.249690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1059/2114] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:42 2022] PUT /identity/v3/projects/36cf8f64e03a4f7e9b3fba14441bc24a/users/0bae028e34e54ef4bfe4849bd36d5ea4/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:42.251466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:42.286881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf01ca-7004-4930-891c-305d8db34b1d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:42.289867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:42.292373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:42.411276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:42.411909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.412187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.412458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.413112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:42.414896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:42.426126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1056/2115] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:42.431707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:42.444506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb421b6-2418-4f7f-b3b4-db0f94742c9d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:42.450835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce308967-5e4d-4906-886f-afafec6d8953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:42.451519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308967-5e4d-4906-886f-afafec6d8953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.451796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308967-5e4d-4906-886f-afafec6d8953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.452116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308967-5e4d-4906-886f-afafec6d8953 admin admin] PATH_INFO: `/v3/projects/36cf8f64e03a4f7e9b3fba14441bc24a/users/0bae028e34e54ef4bfe4849bd36d5ea4/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.455668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce308967-5e4d-4906-886f-afafec6d8953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cf8f64e03a4f7e9b3fba14441bc24a, user_id=0bae028e34e54ef4bfe4849bd36d5ea4, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:42.459333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce308967-5e4d-4906-886f-afafec6d8953 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:42.474167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1057/2116] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:42 2022] PUT /identity/v3/projects/36cf8f64e03a4f7e9b3fba14441bc24a/users/0bae028e34e54ef4bfe4849bd36d5ea4/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:42.478084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3838ef-3b22-429f-b409-74fb1addd3dc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:42.493102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.493389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.495391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.527621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:42.528036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] MFA Rules not processed for user `0bae028e34e54ef4bfe4849bd36d5ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:42.529665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:42.610035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:42.610994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.611544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.611911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] PATH_INFO: `/v3/projects/31c800edc7c0483b85fa9f24b34159ad` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.613411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c800edc7c0483b85fa9f24b34159ad)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:42.615702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:42.642840 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:42.662629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1058/2117] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:42.681129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:42.682456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:42.764470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c800edc7c0483b85fa9f24b34159ad', 'request_id': 'req-747c575e-a567-4de0-be21-ea0b43470b11'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:42.784052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c800edc7c0483b85fa9f24b34159ad', 'request_id': 'req-747c575e-a567-4de0-be21-ea0b43470b11'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:42.803825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480877a-6a10-4f2a-91b6-717220648963 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:42.804204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c800edc7c0483b85fa9f24b34159ad', 'request_id': 'req-747c575e-a567-4de0-be21-ea0b43470b11'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:42.830768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] The token cache is being invalidate because project 31c800edc7c0483b85fa9f24b34159ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:42.831471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:42.833551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-747c575e-a567-4de0-be21-ea0b43470b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:42.838763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1060/2118] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:42 2022] DELETE /identity/v3/projects/31c800edc7c0483b85fa9f24b34159ad => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:42.845285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01d3da-9511-41af-9a11-f0db27e0388f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.849435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01d3da-9511-41af-9a11-f0db27e0388f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.850383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01d3da-9511-41af-9a11-f0db27e0388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.884642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:42.885457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.886384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.886384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:42.894494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:42.895035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9b01d3da-9511-41af-9a11-f0db27e0388f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:42.899706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b01d3da-9511-41af-9a11-f0db27e0388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:42.991772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1061/2119] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:42.999266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782581c-bf4b-413f-980f-91a615f45d59 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:42.999637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782581c-bf4b-413f-980f-91a615f45d59 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:42.999987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782581c-bf4b-413f-980f-91a615f45d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.023736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b782581c-bf4b-413f-980f-91a615f45d59 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:43.027782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b782581c-bf4b-413f-980f-91a615f45d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:43.045766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.047452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.049394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1062/2120] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:43.055622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782581c-bf4b-413f-980f-91a615f45d59 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.067963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782581c-bf4b-413f-980f-91a615f45d59 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.073562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1059/2121] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:43.076485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.077379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.077757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.078128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.078938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:43.079509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.082377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.096847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1063/2122] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:43.100928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.113760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52a16-f3d3-402e-8e29-920f56155d4a service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.119792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.120626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.121131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.121594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.122472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.124594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.164422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1060/2123] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:43.168928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.184168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752cb7c-cd62-4ccd-8679-20c99b2b99d1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.249960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:43.328353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.330761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.331057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.331341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.332305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.335506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.370407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1064/2124] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:43 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:43.376113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.394289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccd247-5642-45e9-9373-6947da7cac57 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.412503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.413121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.413409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.413695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.414359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.416137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.445611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1061/2125] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:43.448309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.476933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78b2a-0623-4fa8-9abf-bdd35bcc8a2d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.485538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.486892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.487315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.487634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.488361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.490084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.509677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1065/2126] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:43.513682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.525856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ddcf9-961e-47b0-b650-54d1a871c1e1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.530890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3848-4b41-49b6-b585-b7643bd73325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.531699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3848-4b41-49b6-b585-b7643bd73325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.532362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3848-4b41-49b6-b585-b7643bd73325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.532362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3848-4b41-49b6-b585-b7643bd73325 admin admin] PATH_INFO: `/v3/projects/e35b1ada06d2464281781b407c214325/users/c6729dcec9254e10ba5c500d359514f5/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.559816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3848-4b41-49b6-b585-b7643bd73325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35b1ada06d2464281781b407c214325, user_id=c6729dcec9254e10ba5c500d359514f5, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.562851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3848-4b41-49b6-b585-b7643bd73325 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.590286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.597032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1062/2127] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:43 2022] PUT /identity/v3/projects/e35b1ada06d2464281781b407c214325/users/c6729dcec9254e10ba5c500d359514f5/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:43.614925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.615142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.615397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.648849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:43.674548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] MFA Rules not processed for user `c6729dcec9254e10ba5c500d359514f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:43.675895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:43.714697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f59a3-7d3e-4d20-bfd8-3ef0d9300ac8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.819121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bae028e34e54ef4bfe4849bd36d5ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36cf8f64e03a4f7e9b3fba14441bc24a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.819860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1063/2128] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:43.820255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.820546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.820822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.821764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:43.823262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.823979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.825282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.825419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:43.839955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1066/2129] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:36:43.840894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:43.936345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d003936-8bc4-47da-9460-974a8b8cf0ae None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.936986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:43.942136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.943125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.943628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.944162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] PATH_INFO: `/v3/users/d3a58460cdb543d6b3c49823d9317928` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.945589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a58460cdb543d6b3c49823d9317928)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.948114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.950094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bad3d-01d9-42d3-8d10-13e7a10311be tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:43.956852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:43.957207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:43.957597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:43.958094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:43.959223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:43.961376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:43.998288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1067/2130] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:43 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:44.002877 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.015632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a58460cdb543d6b3c49823d9317928'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.027445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a58460cdb543d6b3c49823d9317928'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.028528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a58460cdb543d6b3c49823d9317928'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.029414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a58460cdb543d6b3c49823d9317928'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.040091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a58460cdb543d6b3c49823d9317928'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.063803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1064/2131] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:43 2022] DELETE /identity/v3/users/d3a58460cdb543d6b3c49823d9317928 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:44.065220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.066867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:44.079493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628070-ba6d-4a8a-9e4e-804d092c322a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.099857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:44.194122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583991a4-c21a-41d2-9adb-3775c01e34eb tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bae028e34e54ef4bfe4849bd36d5ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36cf8f64e03a4f7e9b3fba14441bc24a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.195042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583991a4-c21a-41d2-9adb-3775c01e34eb tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.195505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583991a4-c21a-41d2-9adb-3775c01e34eb tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.195997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583991a4-c21a-41d2-9adb-3775c01e34eb tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.196945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583991a4-c21a-41d2-9adb-3775c01e34eb tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.198954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583991a4-c21a-41d2-9adb-3775c01e34eb tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.200016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d15746-1041-42c3-be3f-4a6be6f2013a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.209394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.210474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.210906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.211265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.212497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.214414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.264799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1068/2132] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:44 2022] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:44.271152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1065/2133] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:44 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:44.271311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f336d-ed86-4a40-9521-1d5239688580 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.271311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f336d-ed86-4a40-9521-1d5239688580 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.271311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f336d-ed86-4a40-9521-1d5239688580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.271590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.273799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:44.290695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228810ed-143f-4232-bf77-cb68e556ad33 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.301728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c31f336d-ed86-4a40-9521-1d5239688580 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:44.303586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c31f336d-ed86-4a40-9521-1d5239688580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:44.371073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bae028e34e54ef4bfe4849bd36d5ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36cf8f64e03a4f7e9b3fba14441bc24a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.371694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.371976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.372257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.372899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:44.373204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.378136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1069/2134] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:44.378136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f336d-ed86-4a40-9521-1d5239688580 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.378551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.387852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f336d-ed86-4a40-9521-1d5239688580 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.394380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.395088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.395800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.395917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.399266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1066/2135] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:44.399401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.399514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.399614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.411076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1070/2136] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:44.412245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:44.415409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.425578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:44.436181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5f5c-069d-4d93-9734-2f23b6293890 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.453684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.455792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.456246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.457079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] PATH_INFO: `/v3/projects/afa1621bf04c4c6795387b3ac6cdeb02/users/25a78e0e5c7246859970d456c2678fbd/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.485555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa1621bf04c4c6795387b3ac6cdeb02, user_id=25a78e0e5c7246859970d456c2678fbd, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.489250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.510813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1071/2137] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:44 2022] PUT /identity/v3/projects/afa1621bf04c4c6795387b3ac6cdeb02/users/25a78e0e5c7246859970d456c2678fbd/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:44.523734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.544644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe69ed-46c6-453d-96b4-ef1109e7a98e tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.609125 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.609842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.610160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.610465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.620222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:44.636221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629897c0-142c-48eb-bd01-e2c4c27eed02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.652575 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bae028e34e54ef4bfe4849bd36d5ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36cf8f64e03a4f7e9b3fba14441bc24a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.653431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.653724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.654012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] PATH_INFO: `/v3/projects/ad761a5bb8b44587a6ca954fd6be7e9b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.657656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad761a5bb8b44587a6ca954fd6be7e9b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.660684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.743428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.745373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.766113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1067/2138] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:44.766943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.777691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa36af-c310-4a0e-8f52-d4954cefb989 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.807218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad761a5bb8b44587a6ca954fd6be7e9b', 'request_id': 'req-79e26ed2-ff72-4720-b867-3416c6888eb8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.824656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad761a5bb8b44587a6ca954fd6be7e9b', 'request_id': 'req-79e26ed2-ff72-4720-b867-3416c6888eb8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.856107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad761a5bb8b44587a6ca954fd6be7e9b', 'request_id': 'req-79e26ed2-ff72-4720-b867-3416c6888eb8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.872813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.873503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.873796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.874123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.874834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.877480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.887146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] The token cache is being invalidate because project ad761a5bb8b44587a6ca954fd6be7e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:44.887338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.889053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1068/2139] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:44.889234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79e26ed2-ff72-4720-b867-3416c6888eb8 tempest-VolumeQuotaClassesTest-2001053925 tempest-VolumeQuotaClassesTest-2001053925-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:44.892703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1072/2140] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:44 2022] DELETE /identity/v3/projects/ad761a5bb8b44587a6ca954fd6be7e9b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:44.893966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:44.897966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:44.920980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d0a34-681e-46ab-8e11-4aa039b238a8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:44.928950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:44.929957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.930409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.930829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] PATH_INFO: `/v3/projects/afa1621bf04c4c6795387b3ac6cdeb02/users/25a78e0e5c7246859970d456c2678fbd/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:44.933918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa1621bf04c4c6795387b3ac6cdeb02, user_id=25a78e0e5c7246859970d456c2678fbd, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:44.938841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:44.978606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1069/2141] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:44 2022] PUT /identity/v3/projects/afa1621bf04c4c6795387b3ac6cdeb02/users/25a78e0e5c7246859970d456c2678fbd/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:44.980605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:44.981187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:44.981497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:45.022900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] MFA Rules not processed for user `25a78e0e5c7246859970d456c2678fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:45.024656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:45.204994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:45.232170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1073/2142] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:45.250661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:45.253519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:45.356837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d21a-5606-4637-86ee-7b66005a265c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:45.384665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:45.386796 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:45.388569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:45.389042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:45.420121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:45.425403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:45.442642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:45.445193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:45.465018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1070/2143] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:45.594826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:45.599061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71899aeb-9cc6-4601-83e6-4324def16c58 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:45.609696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:45.610603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:45.611584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:45.612041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] PATH_INFO: `/v3/users/9c6baee8002a43a58fd40d43ce373faa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:45.615585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6baee8002a43a58fd40d43ce373faa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:45.619409 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:45.640405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac0ecc-25d9-4571-b835-f859e2d19e4b service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:45.645952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:45.647101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:45.647557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:45.649534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:45.652103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:45.716750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6baee8002a43a58fd40d43ce373faa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:45.717520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6baee8002a43a58fd40d43ce373faa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:45.734398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6baee8002a43a58fd40d43ce373faa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:45.741783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:45.745001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6baee8002a43a58fd40d43ce373faa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:45.769633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a185d46-4348-48b5-8a80-a7f2c391c2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6baee8002a43a58fd40d43ce373faa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:45.792661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1074/2144] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:45 2022] DELETE /identity/v3/users/9c6baee8002a43a58fd40d43ce373faa => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:45.794552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:45.794844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:45.795122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:45.816542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:45.818705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:45.824739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:45.827133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:45.858314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1071/2145] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:45.915807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1075/2146] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:45.975825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:45.978882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:46.200550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6068-6ae4-476b-a384-3a08b42db762 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:46.309113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:46.311010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:46.318786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:46.319464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:46.319748 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:46.320042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:46.330661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ee433-a828-41e7-87cb-9088dc0f106f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:46.331897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:46.333425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:46.339082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:46.340224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:46.340507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:46.341193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] PATH_INFO: `/v3/users/c6729dcec9254e10ba5c500d359514f5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:46.343416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6729dcec9254e10ba5c500d359514f5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:46.344648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1072/2147] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:46.344901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:46.359978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:46.442239 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:46.444299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:46.453926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6729dcec9254e10ba5c500d359514f5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.455703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6729dcec9254e10ba5c500d359514f5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.467315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc199d-f420-4e41-92d3-1e5ceb1f263b service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:46.473194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6729dcec9254e10ba5c500d359514f5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.485195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:46.486870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:46.487161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:46.487434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] PATH_INFO: `/v3/projects/e43b2f2da23d4885ba070728e356a83f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:46.489245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6729dcec9254e10ba5c500d359514f5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.491070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43b2f2da23d4885ba070728e356a83f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:46.496258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:46.520178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fb6bb89-b829-456f-9073-3e2881ad9445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6729dcec9254e10ba5c500d359514f5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.536531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1076/2148] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:46 2022] DELETE /identity/v3/users/c6729dcec9254e10ba5c500d359514f5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:46.540963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:46.541353 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:46.542639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:46.609396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43b2f2da23d4885ba070728e356a83f', 'request_id': 'req-cab63eb4-fd3a-4cda-9ad6-d02db6296073'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.617594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43b2f2da23d4885ba070728e356a83f', 'request_id': 'req-cab63eb4-fd3a-4cda-9ad6-d02db6296073'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.624344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:46.627618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:46.629452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43b2f2da23d4885ba070728e356a83f', 'request_id': 'req-cab63eb4-fd3a-4cda-9ad6-d02db6296073'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.648459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] The token cache is being invalidate because project e43b2f2da23d4885ba070728e356a83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:46.649076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.649968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.652288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1073/2149] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:46 2022] DELETE /identity/v3/projects/e43b2f2da23d4885ba070728e356a83f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:46.656215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:46.658417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:46.676202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:46.714516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1077/2150] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:46.742536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab63eb4-fd3a-4cda-9ad6-d02db6296073 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:46.749473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:46.749473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:46.749473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:46.749473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] PATH_INFO: `/v3/users/f2b2e8d27a4f457d860601f484300ae1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:46.749995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b2e8d27a4f457d860601f484300ae1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:46.752693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:46.760470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:46.768568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:46.840364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b2e8d27a4f457d860601f484300ae1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.860811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b2e8d27a4f457d860601f484300ae1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.862742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b2e8d27a4f457d860601f484300ae1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.865007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b2e8d27a4f457d860601f484300ae1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.880285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907640-68b5-49f1-9f09-a97831ce224c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:46.884883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:46.885586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:46.886537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:46.886537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:46.887285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b2e8d27a4f457d860601f484300ae1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:46.889469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:46.908019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:46.910190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:46.924242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1074/2151] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:46 2022] DELETE /identity/v3/users/f2b2e8d27a4f457d860601f484300ae1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:46.924862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1078/2152] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:47.041231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:47.043119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:47.162186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ca4b1-3b7c-4e57-9419-eb53e0925bab admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:47.167331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:47.168135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:47.168517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:47.169022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] PATH_INFO: `/v3/projects/f7c935aff80441eaaf5131a1aabd1fb6` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:47.170286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c935aff80441eaaf5131a1aabd1fb6)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:47.172408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:47.232452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:47.292817 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c935aff80441eaaf5131a1aabd1fb6', 'request_id': 'req-64161ca3-255c-48cf-bf07-6a4c3732b0d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.306668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c935aff80441eaaf5131a1aabd1fb6', 'request_id': 'req-64161ca3-255c-48cf-bf07-6a4c3732b0d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.320282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c935aff80441eaaf5131a1aabd1fb6', 'request_id': 'req-64161ca3-255c-48cf-bf07-6a4c3732b0d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.367258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] The token cache is being invalidate because project f7c935aff80441eaaf5131a1aabd1fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:47.367717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.370028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.373514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1075/2153] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:47 2022] DELETE /identity/v3/projects/f7c935aff80441eaaf5131a1aabd1fb6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:47.377059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:47.391928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251fe2-296b-4c74-ba6d-f74bdbffd6e1 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:47.410330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:47.412094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:47.443824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:47.505034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:47.505678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:47.505963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:47.506237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] PATH_INFO: `/v3/users/0bae028e34e54ef4bfe4849bd36d5ea4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:47.507457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bae028e34e54ef4bfe4849bd36d5ea4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:47.509578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:47.545374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161ca3-255c-48cf-bf07-6a4c3732b0d3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:47.554069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:47.554876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:47.555353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:47.555800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] PATH_INFO: `/v3/projects/50e0bb18b2094c998bac4bd2e0c577bd` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:47.557233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e0bb18b2094c998bac4bd2e0c577bd)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:47.559819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:47.585861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bae028e34e54ef4bfe4849bd36d5ea4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.586765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bae028e34e54ef4bfe4849bd36d5ea4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.612111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bae028e34e54ef4bfe4849bd36d5ea4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.643887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bae028e34e54ef4bfe4849bd36d5ea4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.644266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e0bb18b2094c998bac4bd2e0c577bd', 'request_id': 'req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.660825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e0bb18b2094c998bac4bd2e0c577bd', 'request_id': 'req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.687360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bee4f118-3891-44af-a8f0-b8b8d6ee9f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bae028e34e54ef4bfe4849bd36d5ea4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.694741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e0bb18b2094c998bac4bd2e0c577bd', 'request_id': 'req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.699996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1079/2154] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:47 2022] DELETE /identity/v3/users/0bae028e34e54ef4bfe4849bd36d5ea4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:47.711116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] The token cache is being invalidate because project 50e0bb18b2094c998bac4bd2e0c577bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:47.711551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.712523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cfd0c3f3-7dd0-473f-9966-00cc5c24aa3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:47.714670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1076/2155] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:47 2022] DELETE /identity/v3/projects/50e0bb18b2094c998bac4bd2e0c577bd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:47.719442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bbad5-a6b5-42c0-a40f-092249daac08 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:47.719911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bbad5-a6b5-42c0-a40f-092249daac08 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:47.720447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bbad5-a6b5-42c0-a40f-092249daac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:47.752800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-821bbad5-a6b5-42c0-a40f-092249daac08 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:47.754906 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-821bbad5-a6b5-42c0-a40f-092249daac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:47.861653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1080/2156] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:47.867997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76696-ffa0-45a3-9331-0c3f229fbd6e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:47.872918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76696-ffa0-45a3-9331-0c3f229fbd6e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:47.873369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76696-ffa0-45a3-9331-0c3f229fbd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:47.939619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ffb76696-ffa0-45a3-9331-0c3f229fbd6e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:47.942864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ffb76696-ffa0-45a3-9331-0c3f229fbd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:47.973945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1077/2157] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:47.979390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bbad5-a6b5-42c0-a40f-092249daac08 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:47.993825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bbad5-a6b5-42c0-a40f-092249daac08 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.000844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.001673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.002222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.002694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.003450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:48.005193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.007514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.024094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1081/2158] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:48.029556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb76696-ffa0-45a3-9331-0c3f229fbd6e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.061482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb76696-ffa0-45a3-9331-0c3f229fbd6e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.069825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.070809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.072121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.072579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.073409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.076154 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.122801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1078/2159] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:48 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:48.128249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.147683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d78f12-17ab-4a2d-8ae5-e30297748a52 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.283196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:48.348263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.348902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.349296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.349669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.350507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.352983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.384188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1082/2160] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:48 2022] POST /identity/v3/users => generated 296 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:48.388810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.423073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e4d41-c272-4cfa-98f3-1edc81d92a53 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.430684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.431465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.431839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.432123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.433821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.435628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.440552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.443693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:48.453898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1079/2161] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:48.463007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.468153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bc163-4b20-46e5-b70d-136a2cff1325 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.474428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.475071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.475400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.475677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] PATH_INFO: `/v3/projects/e35b1ada06d2464281781b407c214325` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.477082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131d19-0d7a-4278-b270-c61919caa662 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.482207 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.483121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.483510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.483833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35b1ada06d2464281781b407c214325)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.483948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.484693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.487049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.492222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.497515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:48.509383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1080/2162] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:48.511555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.530333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286014f-e608-4bbb-926b-14bb708c84cb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.541602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628d4fe-891f-40b0-b21b-07f718525005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.542285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628d4fe-891f-40b0-b21b-07f718525005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.542601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628d4fe-891f-40b0-b21b-07f718525005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.542883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628d4fe-891f-40b0-b21b-07f718525005 admin admin] PATH_INFO: `/v3/projects/880aef80c9bf4884829ddbe994bb3713/users/82f2b13a717d426d9e3a2680d9c1f9b0/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.582627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628d4fe-891f-40b0-b21b-07f718525005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880aef80c9bf4884829ddbe994bb3713, user_id=82f2b13a717d426d9e3a2680d9c1f9b0, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.584472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628d4fe-891f-40b0-b21b-07f718525005 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.589321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35b1ada06d2464281781b407c214325', 'request_id': 'req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.601810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35b1ada06d2464281781b407c214325', 'request_id': 'req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.602478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1081/2163] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:48 2022] PUT /identity/v3/projects/880aef80c9bf4884829ddbe994bb3713/users/82f2b13a717d426d9e3a2680d9c1f9b0/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:48.618529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.618770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.619111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.623809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35b1ada06d2464281781b407c214325', 'request_id': 'req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.649805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] The token cache is being invalidate because project e35b1ada06d2464281781b407c214325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:48.650106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.651026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.656573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1083/2164] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:48 2022] DELETE /identity/v3/projects/e35b1ada06d2464281781b407c214325 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:48.664801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.667017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:48.678794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] MFA Rules not processed for user `82f2b13a717d426d9e3a2680d9c1f9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:48.682804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:48.792256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097e8d9-f7d4-4f8d-a45a-bc156fcee593 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.826046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1082/2165] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:48.827021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:48.828481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:48.889601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:48.900062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.900803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.901087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.901357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] PATH_INFO: `/v3/users/25a78e0e5c7246859970d456c2678fbd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.902718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a78e0e5c7246859970d456c2678fbd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.904900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.941190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8974bf-33be-4fc7-ac60-fea04decb1ce None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:48.946851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:48.947493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:48.947774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:48.948049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] PATH_INFO: `/v3/users/f71ca39699984435ba165b5c24ee81a9` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:48.949209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71ca39699984435ba165b5c24ee81a9)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:48.951215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:48.959483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a78e0e5c7246859970d456c2678fbd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.960156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a78e0e5c7246859970d456c2678fbd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.968572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a78e0e5c7246859970d456c2678fbd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.978920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a78e0e5c7246859970d456c2678fbd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:48.999998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a78e0e5c7246859970d456c2678fbd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.009276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71ca39699984435ba165b5c24ee81a9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.014797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1084/2166] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:48 2022] DELETE /identity/v3/users/25a78e0e5c7246859970d456c2678fbd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:49.018936 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.021226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.027238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71ca39699984435ba165b5c24ee81a9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.028263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71ca39699984435ba165b5c24ee81a9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.029925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71ca39699984435ba165b5c24ee81a9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.044684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71ca39699984435ba165b5c24ee81a9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.056706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:49.105458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1083/2167] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:48 2022] DELETE /identity/v3/users/f71ca39699984435ba165b5c24ee81a9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:49.109022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.113271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.145621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c07ad-945c-463f-9ec5-aef1cb02d5f9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.231868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc76f-b7af-4401-9711-bbb9660d43d5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.242471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.243266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.243573 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.244396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] PATH_INFO: `/v3/projects/36cf8f64e03a4f7e9b3fba14441bc24a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.245169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cf8f64e03a4f7e9b3fba14441bc24a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.247317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.249602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.250440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.250866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.251151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.252401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.254807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.299536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1085/2168] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:49 2022] POST /identity/v3/projects => generated 391 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:49.300678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.303050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.319900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:49.348909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cf8f64e03a4f7e9b3fba14441bc24a', 'request_id': 'req-71aced4d-060e-4afc-a898-b3cd5f38cce8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.358836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cf8f64e03a4f7e9b3fba14441bc24a', 'request_id': 'req-71aced4d-060e-4afc-a898-b3cd5f38cce8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.389089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cf8f64e03a4f7e9b3fba14441bc24a', 'request_id': 'req-71aced4d-060e-4afc-a898-b3cd5f38cce8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.402112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] The token cache is being invalidate because project 36cf8f64e03a4f7e9b3fba14441bc24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:49.402837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.404080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-71aced4d-060e-4afc-a898-b3cd5f38cce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.407568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1084/2169] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:49 2022] DELETE /identity/v3/projects/36cf8f64e03a4f7e9b3fba14441bc24a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:49.413234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4835-ff51-4f62-9c26-2d49960e0ef8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.413525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4835-ff51-4f62-9c26-2d49960e0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.413799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4835-ff51-4f62-9c26-2d49960e0ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.414296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794236-0378-4259-b57f-76e00c5abc20 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.436343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0d1c4835-ff51-4f62-9c26-2d49960e0ef8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:49.437692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0d1c4835-ff51-4f62-9c26-2d49960e0ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.477092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.477742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.478146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.478516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.479496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.482213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.512057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1086/2170] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:49 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:49.516186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.517951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.526508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1085/2171] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:49.534788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.535129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.535363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.543665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64ef5a-9795-4932-8a15-d347bc4e3b3b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.551357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.551992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.552275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.552553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.553349 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.555599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.569944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1087/2172] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:49.574058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.579263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:49.582144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.587850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bad58c-9396-4f96-9c7b-720270e5f735 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.592436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1086/2173] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:49.593560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.595065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.596806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.597086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.597370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] PATH_INFO: `/v3/projects/482a90b405f4447bbfc7d56403f205de/users/3ad4d22a02ac4dfabc263c321c62b96a/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.598987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.614611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482a90b405f4447bbfc7d56403f205de, user_id=3ad4d22a02ac4dfabc263c321c62b96a, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.622021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b566-8a4f-4cb0-8ff1-481f9b3a7164 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.624847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.645211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1088/2174] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:49 2022] PUT /identity/v3/projects/482a90b405f4447bbfc7d56403f205de/users/3ad4d22a02ac4dfabc263c321c62b96a/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:49.646505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.647623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.648549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.648808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.649127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] PATH_INFO: `/v3/projects/82efbd082dcc41b68219678c691e5c70` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.651040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82efbd082dcc41b68219678c691e5c70)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.652972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.660230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:49.718428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82efbd082dcc41b68219678c691e5c70', 'request_id': 'req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.725698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82efbd082dcc41b68219678c691e5c70', 'request_id': 'req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.731314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037a9d-552f-495f-b9d3-0c2368e76199 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.735179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82efbd082dcc41b68219678c691e5c70', 'request_id': 'req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.744987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:49.749144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] The token cache is being invalidate because project 82efbd082dcc41b68219678c691e5c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:49.749444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.750123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.752261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1087/2175] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:49 2022] DELETE /identity/v3/projects/82efbd082dcc41b68219678c691e5c70 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:49.754495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.756138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.794607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.795266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.795668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.795944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.796593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:49.796903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.798623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.810576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1089/2176] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:49.811462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.816166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.837074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad92b6-3d2d-48bf-9e0e-ac3c171103b0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.840693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c729-03dc-4bd7-aa51-2e9c5916b6c6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:49.845868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.846570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.846900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.847184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] PATH_INFO: `/v3/projects/afa1621bf04c4c6795387b3ac6cdeb02` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.848383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa1621bf04c4c6795387b3ac6cdeb02)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.850324 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.852897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9933c-b04d-4b01-955c-3abff0c8059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:49.853693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9933c-b04d-4b01-955c-3abff0c8059a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.854064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9933c-b04d-4b01-955c-3abff0c8059a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.854468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9933c-b04d-4b01-955c-3abff0c8059a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.856029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9933c-b04d-4b01-955c-3abff0c8059a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:49.858276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9933c-b04d-4b01-955c-3abff0c8059a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:49.874603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1090/2177] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:49.877249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:49.877595 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:49.878081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:49.917582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:49.918843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.924475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa1621bf04c4c6795387b3ac6cdeb02', 'request_id': 'req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.930672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa1621bf04c4c6795387b3ac6cdeb02', 'request_id': 'req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.938740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa1621bf04c4c6795387b3ac6cdeb02', 'request_id': 'req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.949973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] The token cache is being invalidate because project afa1621bf04c4c6795387b3ac6cdeb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:49.950269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.951058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:49.952580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1088/2178] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:49 2022] DELETE /identity/v3/projects/afa1621bf04c4c6795387b3ac6cdeb02 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:49.953309 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.954676 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:49.982153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:49.986318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1091/2179] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:49.987132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:49.993246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.005699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43154ea0-79af-4a36-8ed1-0571dd4f77da None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.010505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6340ad0-fb66-42fe-b568-0da5695c3853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.011161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340ad0-fb66-42fe-b568-0da5695c3853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.011448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340ad0-fb66-42fe-b568-0da5695c3853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.011721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340ad0-fb66-42fe-b568-0da5695c3853 admin admin] PATH_INFO: `/v3/projects/482a90b405f4447bbfc7d56403f205de/users/3ad4d22a02ac4dfabc263c321c62b96a/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.013653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6340ad0-fb66-42fe-b568-0da5695c3853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482a90b405f4447bbfc7d56403f205de, user_id=3ad4d22a02ac4dfabc263c321c62b96a, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.016555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6340ad0-fb66-42fe-b568-0da5695c3853 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.024588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef18bc4-f22b-4e7c-a7b0-75f01a958966 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.027619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1092/2180] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:49 2022] PUT /identity/v3/projects/482a90b405f4447bbfc7d56403f205de/users/3ad4d22a02ac4dfabc263c321c62b96a/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:50.035860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbbad-a940-4037-aec9-c3e12fdabfd7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.035860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbbad-a940-4037-aec9-c3e12fdabfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.035860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbbad-a940-4037-aec9-c3e12fdabfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.050390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c81dbbad-a940-4037-aec9-c3e12fdabfd7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:50.051625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c81dbbad-a940-4037-aec9-c3e12fdabfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.091823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761716a-9f96-4348-bc2f-6f542684b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.092454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761716a-9f96-4348-bc2f-6f542684b632 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.092733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761716a-9f96-4348-bc2f-6f542684b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.093004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761716a-9f96-4348-bc2f-6f542684b632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.093629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761716a-9f96-4348-bc2f-6f542684b632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.095569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761716a-9f96-4348-bc2f-6f542684b632 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.115536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1093/2181] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:50.116622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bdb0-3e87-430f-a015-fc311eb9f8fb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.116915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bdb0-3e87-430f-a015-fc311eb9f8fb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.117185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bdb0-3e87-430f-a015-fc311eb9f8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.123969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1089/2182] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:49 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:50.125122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23126-fc76-4d96-b9fc-f0deb351aaf4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.125416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23126-fc76-4d96-b9fc-f0deb351aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.125695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23126-fc76-4d96-b9fc-f0deb351aaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.139658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-44e2bdb0-3e87-430f-a015-fc311eb9f8fb None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:50.140887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-44e2bdb0-3e87-430f-a015-fc311eb9f8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.154754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3ae23126-fc76-4d96-b9fc-f0deb351aaf4 None None] MFA Rules not processed for user `3ad4d22a02ac4dfabc263c321c62b96a`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:50.155968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3ae23126-fc76-4d96-b9fc-f0deb351aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.168772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:50.220802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1094/2183] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:50.222269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c702849-1527-444d-b735-c6a427806ff4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.222594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c702849-1527-444d-b735-c6a427806ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.222872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c702849-1527-444d-b735-c6a427806ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.234682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1090/2184] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:50.235518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23126-fc76-4d96-b9fc-f0deb351aaf4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.248706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5c702849-1527-444d-b735-c6a427806ff4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:50.250393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5c702849-1527-444d-b735-c6a427806ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.250582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23126-fc76-4d96-b9fc-f0deb351aaf4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.267137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1095/2185] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:50.268453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c702849-1527-444d-b735-c6a427806ff4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.279513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.280170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.280460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.280740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.281392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.283381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c702849-1527-444d-b735-c6a427806ff4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.284054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.289660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.290335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.290655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.290928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.291640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:50.291952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.293620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.308836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1096/2186] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:50.309695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.315513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.323863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1091/2187] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:50.323863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.339479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179d0da-8352-43ab-8076-c0ffad216b23 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.344284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.346894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.347376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.347960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.348829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:50.349204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.351013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.369366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1092/2188] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:50.371134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.383685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237faf4-6299-48c3-87ff-b9dc18c37d33 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.388832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.389437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.389720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.389993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.390675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.392918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fbb41-9bdf-43a9-ae0b-e7d030070c24 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.393308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.397094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.398050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.398510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.398963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:50.399083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.416552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.418016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.432854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1093/2189] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:50.434026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.436570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1097/2190] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:50.458022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.482478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aab9a-44ce-4f17-a85c-e978c228ecc2 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.542249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9c65-a8ca-4686-852e-1aa475c2b033 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.547203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.547822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.548101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.548371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.549026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.550660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.561152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1094/2191] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:50.562064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.570159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.570900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.571248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.571855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.572495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.574596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.575258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32c501-3e2c-4ced-a900-8224cb33a19d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.581243 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.581912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.582261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.582634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.583915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.586093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.607019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1098/2192] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/projects => generated 359 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:50.608318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.612612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1095/2193] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/users => generated 294 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:50.612612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.613664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.623342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eb5c8-31e2-4237-8c33-026b3efac71f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.658840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:50.680236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82be621-b2a5-46bc-ba14-966f9716798f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.684851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.685129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.685397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.685746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.687526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:50.688900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.689247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.689531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.689954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.690647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.692562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.703511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1096/2194] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:50.705344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.717299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c205db-7e62-4c75-bcb2-8fa8b49759cd admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.723946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.724556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.725228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.725228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.725728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.727702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.753945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1097/2195] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:50 2022] POST /identity/v3/users => generated 280 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:50.754784 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.755993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.757452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.764292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194df8b-1eb0-4bf8-95bf-70c44b070cd9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.766839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1099/2196] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:50.768008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.769490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.770084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.770391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.770672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.771336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.772917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.778820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546f3a5-16ab-4b04-8775-d348581b3351 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.784223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.784882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.785165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.785440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] PATH_INFO: `/v3/projects/bb7aacb87b0747d4a56aa8f04fb58b61/users/382e86b7ad9446dfb532e851893af3d8/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.789336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1098/2197] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:50.789336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.797786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061e457-cc98-438c-a2f0-b98f7eb01928 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.802910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.803688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.804227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.804656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.805553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.808089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.824714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1099/2198] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:50.825479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.840953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e108d-2edc-4f02-9c15-2e658a8289a5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.844306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7aacb87b0747d4a56aa8f04fb58b61, user_id=382e86b7ad9446dfb532e851893af3d8, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.858091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.858765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:50.859047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:50.859321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:50.859978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:50.860248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.861685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:50.872425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1100/2199] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:50.873286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.885934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a81743-1a74-449d-83d1-fd2b7f7a286a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:50.890101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1100/2200] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:50 2022] PUT /identity/v3/projects/bb7aacb87b0747d4a56aa8f04fb58b61/users/382e86b7ad9446dfb532e851893af3d8/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:50.891827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:50.897985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:50.998260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67169893-4a72-4dbd-95b7-f9ac68a30096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:50.999690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67169893-4a72-4dbd-95b7-f9ac68a30096 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.000545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67169893-4a72-4dbd-95b7-f9ac68a30096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.001015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67169893-4a72-4dbd-95b7-f9ac68a30096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.002170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67169893-4a72-4dbd-95b7-f9ac68a30096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.004066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67169893-4a72-4dbd-95b7-f9ac68a30096 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.021334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1101/2201] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:51.023145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8063a11-8f5c-4a0e-9159-3bce4b13e78c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.023631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8063a11-8f5c-4a0e-9159-3bce4b13e78c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.024054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8063a11-8f5c-4a0e-9159-3bce4b13e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.026910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ea84-1539-445c-8e02-4871cd947718 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.044175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.045475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.045939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.046426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] PATH_INFO: `/v3/projects/7591ca9d80184274b0cc805afd938e64/users/a9a2d9f4d9a0464789c9e761f48a4e68/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.063604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7591ca9d80184274b0cc805afd938e64, user_id=a9a2d9f4d9a0464789c9e761f48a4e68, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.065331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f8063a11-8f5c-4a0e-9159-3bce4b13e78c None None] MFA Rules not processed for user `382e86b7ad9446dfb532e851893af3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:51.067246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f8063a11-8f5c-4a0e-9159-3bce4b13e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:51.067856 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.090722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1101/2202] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:50 2022] PUT /identity/v3/projects/7591ca9d80184274b0cc805afd938e64/users/a9a2d9f4d9a0464789c9e761f48a4e68/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:51.094328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.165875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1102/2203] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:51.166553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:51.166737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304573-5363-42e8-b3c9-d3deb54d5b0a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.166836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304573-5363-42e8-b3c9-d3deb54d5b0a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.167141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304573-5363-42e8-b3c9-d3deb54d5b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.185672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c243ca-43f6-47a9-86e3-d2106852a82a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.200645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1b304573-5363-42e8-b3c9-d3deb54d5b0a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:51.202137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1b304573-5363-42e8-b3c9-d3deb54d5b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:51.206991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.207898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.208382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.208787 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] PATH_INFO: `/v3/projects/e60d91a658b843e9bec7cc637af98bd3/users/2e983cf4249c4116b2de03e364731822/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.211954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1103/2204] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:51.213696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b304573-5363-42e8-b3c9-d3deb54d5b0a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.225610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60d91a658b843e9bec7cc637af98bd3, user_id=2e983cf4249c4116b2de03e364731822, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.227959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.232658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b304573-5363-42e8-b3c9-d3deb54d5b0a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.239411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a55685-1648-4089-929f-c70fa0589ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.240164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55685-1648-4089-929f-c70fa0589ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.240503 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55685-1648-4089-929f-c70fa0589ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.240992 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55685-1648-4089-929f-c70fa0589ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.241752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a55685-1648-4089-929f-c70fa0589ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.242543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1102/2205] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:51 2022] PUT /identity/v3/projects/e60d91a658b843e9bec7cc637af98bd3/users/2e983cf4249c4116b2de03e364731822/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:51.243599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.245149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:51.253209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a55685-1648-4089-929f-c70fa0589ccc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.289189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1104/2206] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:51 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:51.289189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c437-ef79-49a1-b7b5-36023a1837b9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.289189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c437-ef79-49a1-b7b5-36023a1837b9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.289189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c437-ef79-49a1-b7b5-36023a1837b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.315791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e0b2c437-ef79-49a1-b7b5-36023a1837b9 None None] MFA Rules not processed for user `2e983cf4249c4116b2de03e364731822`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:51.317009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e0b2c437-ef79-49a1-b7b5-36023a1837b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:51.321755 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108d34-97b2-45db-84ff-ba3c1c80b71e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.371682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.372310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.372573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.372844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.378468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:51.384755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1105/2207] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:51.385944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2c437-ef79-49a1-b7b5-36023a1837b9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.449020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.450479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.461677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1103/2208] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:51.461848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2c437-ef79-49a1-b7b5-36023a1837b9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.462775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.468277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.468969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.469392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.469726 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.470470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.473123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.500400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1106/2209] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:51 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:51.505769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.532301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92226-912b-4995-a63d-987a11bd1253 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.548109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.549261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.549543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.549823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.550526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.552280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.553334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:51.568629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1107/2210] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:51.572735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.587484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188547-b60f-4d88-a022-3d642837e0e0 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.589813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54834af-4143-4403-99cd-8977bbac2296 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.596164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.596835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.597121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.597454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.598725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.599637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.600082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.600551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] PATH_INFO: `/v3/projects/d24beafc81d44c1c837d43428b042071/users/6064551e132348df8a01b2aafa54434c/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.608070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.609715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.619901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24beafc81d44c1c837d43428b042071, user_id=6064551e132348df8a01b2aafa54434c, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.623753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.625829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1104/2211] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:51.645453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.651039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1108/2212] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:51 2022] PUT /identity/v3/projects/d24beafc81d44c1c837d43428b042071/users/6064551e132348df8a01b2aafa54434c/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:51.655063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.658846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745260d-0a93-4b96-a2cc-23b995a9b85a service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.737482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccfdd0-3cde-45a9-a342-29d3ea90aee1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.745586 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.746425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.746705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.746988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.747652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.749916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.770265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.770265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.770265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.770265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] PATH_INFO: `/v3/users/2e983cf4249c4116b2de03e364731822` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.770723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e983cf4249c4116b2de03e364731822)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.770723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.770866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1109/2213] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:51.770866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.785849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d37b1-9e4c-4320-863e-31ed941aeee1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:51.799204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8bbb1-8238-4950-a358-e451c0282c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:51.802891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8bbb1-8238-4950-a358-e451c0282c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.803466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8bbb1-8238-4950-a358-e451c0282c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.804262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8bbb1-8238-4950-a358-e451c0282c80 admin admin] PATH_INFO: `/v3/projects/d24beafc81d44c1c837d43428b042071/users/6064551e132348df8a01b2aafa54434c/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.806736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8bbb1-8238-4950-a358-e451c0282c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24beafc81d44c1c837d43428b042071, user_id=6064551e132348df8a01b2aafa54434c, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:51.809693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8bbb1-8238-4950-a358-e451c0282c80 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:51.836466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1110/2214] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:51 2022] PUT /identity/v3/projects/d24beafc81d44c1c837d43428b042071/users/6064551e132348df8a01b2aafa54434c/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:51.838819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.839156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.839531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.856953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e983cf4249c4116b2de03e364731822'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:51.857987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e983cf4249c4116b2de03e364731822'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:51.871418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e983cf4249c4116b2de03e364731822'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:51.883143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] MFA Rules not processed for user `6064551e132348df8a01b2aafa54434c`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:51.884388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:51.891016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e983cf4249c4116b2de03e364731822'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:51.910790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:51.913029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7886857a-e1be-4058-a9d6-9a99308135d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e983cf4249c4116b2de03e364731822'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:51.923011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1105/2215] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:51 2022] DELETE /identity/v3/users/2e983cf4249c4116b2de03e364731822 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:51.927152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:51.927444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:51.927722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:51.950777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:51.952312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:51.982659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1111/2216] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:51.994902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:51.997733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:52.026148 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:52.045420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1106/2217] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:52.066232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:52.069197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:52.087338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7addc-d038-4a89-a70a-aabd53ec2ade None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:52.164090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd9b4-c9b1-47ec-9e8a-636a545922a8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:52.165197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45d7f4-d138-498d-b395-ec0cd07aa904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:52.167922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:52.168643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:52.169019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:52.169394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:52.171155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45d7f4-d138-498d-b395-ec0cd07aa904 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:52.171594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45d7f4-d138-498d-b395-ec0cd07aa904 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:52.172106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45d7f4-d138-498d-b395-ec0cd07aa904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:52.181939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:52.191450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:52.206693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1107/2218] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:52.324610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45d7f4-d138-498d-b395-ec0cd07aa904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:52.327170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45d7f4-d138-498d-b395-ec0cd07aa904 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:52.341905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1112/2219] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:52.695240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:52.697987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:52.724690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca0a5-c72c-459e-9d2c-442051b2b6d1 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:52.736516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:52.737174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:52.737502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:52.737727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] PATH_INFO: `/v3/projects/e60d91a658b843e9bec7cc637af98bd3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:52.741356 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60d91a658b843e9bec7cc637af98bd3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:52.744683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:52.826705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60d91a658b843e9bec7cc637af98bd3', 'request_id': 'req-5482a803-1a57-4c0b-94b1-b696e2af11ce'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:52.835269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60d91a658b843e9bec7cc637af98bd3', 'request_id': 'req-5482a803-1a57-4c0b-94b1-b696e2af11ce'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:52.848305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60d91a658b843e9bec7cc637af98bd3', 'request_id': 'req-5482a803-1a57-4c0b-94b1-b696e2af11ce'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:52.863381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] The token cache is being invalidate because project e60d91a658b843e9bec7cc637af98bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:52.864101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:52.865017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5482a803-1a57-4c0b-94b1-b696e2af11ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:52.867720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1108/2220] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:52 2022] DELETE /identity/v3/projects/e60d91a658b843e9bec7cc637af98bd3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:52.872717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2fc58-ad6a-4e86-a08a-2fb0e23616ba None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:52.873217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2fc58-ad6a-4e86-a08a-2fb0e23616ba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:52.873321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2fc58-ad6a-4e86-a08a-2fb0e23616ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:52.904222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c3c2fc58-ad6a-4e86-a08a-2fb0e23616ba None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:52.905631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c3c2fc58-ad6a-4e86-a08a-2fb0e23616ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:52.950010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:53.065322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1113/2221] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:53.066751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4fe4-937c-43fa-a05e-f770c307f109 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.067257 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4fe4-937c-43fa-a05e-f770c307f109 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.067350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4fe4-937c-43fa-a05e-f770c307f109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.120968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5d2a4fe4-937c-43fa-a05e-f770c307f109 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:53.123318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d2a4fe4-937c-43fa-a05e-f770c307f109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:53.134717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1109/2222] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:53.138721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2fc58-ad6a-4e86-a08a-2fb0e23616ba None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.154430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2fc58-ad6a-4e86-a08a-2fb0e23616ba None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:53.166968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:53.167478 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.167762 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.168040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.168707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:53.169015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:53.170666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:53.203916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1114/2223] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:53.205485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4fe4-937c-43fa-a05e-f770c307f109 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.219212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4fe4-937c-43fa-a05e-f770c307f109 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:53.229631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:53.229969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.233331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.233653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.236275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:53.241341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:53.314546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1110/2224] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:53 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:53.315946 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.329290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422bd8a-1907-4c30-8d7e-7bb04f517a9a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:53.477710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:53.478658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.479216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.479641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.480485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:53.484311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:53.528723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1115/2225] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:53 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:53.530090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.555610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7e78b-86ab-4e74-bad3-30a1b8449ccf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:53.571924 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:53.572334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.572616 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.572890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.573696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:53.581430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:53.585171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.587348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:53.601685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7720-7cd9-466c-81b3-632b053c64d2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:53.607861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:53.608700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.609090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.609469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] PATH_INFO: `/v3/users/382e86b7ad9446dfb532e851893af3d8` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.611039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=382e86b7ad9446dfb532e851893af3d8)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:53.613368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:53.628478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1111/2226] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:53.629426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.671497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cd045-6fb7-4241-99bd-2ad6e749d33b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:53.679464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:53.680246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.680536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.680804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.681470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:53.683122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:53.685993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382e86b7ad9446dfb532e851893af3d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:53.697916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382e86b7ad9446dfb532e851893af3d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:53.699242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382e86b7ad9446dfb532e851893af3d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:53.700226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382e86b7ad9446dfb532e851893af3d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:53.701141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1112/2227] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:53.704159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.710908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:53.712326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8523c71d-bb34-46e4-8be2-80e0ac7ca9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382e86b7ad9446dfb532e851893af3d8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:53.745957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1116/2228] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:53 2022] DELETE /identity/v3/users/382e86b7ad9446dfb532e851893af3d8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:53.747250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324bf4b-d862-4786-afc0-1da810365cf9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:53.749807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.752048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.752434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.805816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:53.808383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:53.816553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:53.834087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:53.874970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e9736-eb77-476d-8731-5f63a8738fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:53.875653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9736-eb77-476d-8731-5f63a8738fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.876172 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9736-eb77-476d-8731-5f63a8738fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.876588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9736-eb77-476d-8731-5f63a8738fdc admin admin] PATH_INFO: `/v3/projects/c73b1d1ffb3d4afbb9da6244fdaffaa0/users/250156465af64d80bb625a10ae7fe2b1/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.901249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e9736-eb77-476d-8731-5f63a8738fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73b1d1ffb3d4afbb9da6244fdaffaa0, user_id=250156465af64d80bb625a10ae7fe2b1, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:53.904733 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e9736-eb77-476d-8731-5f63a8738fdc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:53.925511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1113/2229] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:53 2022] PUT /identity/v3/projects/c73b1d1ffb3d4afbb9da6244fdaffaa0/users/250156465af64d80bb625a10ae7fe2b1/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:53.935969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:53.936258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:53.936535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:53.955614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1117/2230] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:53.969013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:53.971118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:53.995889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] MFA Rules not processed for user `250156465af64d80bb625a10ae7fe2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:53.998260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:54.108830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249dc88-a688-48b4-9502-f761bbc6bb46 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:54.150636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1114/2231] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:54.165276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:54.166820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:54.248980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:54.249770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:54.250445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:54.250697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:54.323222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816760a-f43e-49fd-af39-6750dd841c6b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:54.327581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:54.328328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:54.328549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:54.328861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:54.341230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:54.342744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:54.354915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1115/2232] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:54.366038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:54.368718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:54.382545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1118/2233] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:54.725619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:54.727336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:54.758274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d559d8-44d8-4c77-a74f-0e4715f373a6 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:54.764282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:54.765184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:54.766844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:54.768324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] PATH_INFO: `/v3/projects/bb7aacb87b0747d4a56aa8f04fb58b61` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:54.771924 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7aacb87b0747d4a56aa8f04fb58b61)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:54.778299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:54.888376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:54.896204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7aacb87b0747d4a56aa8f04fb58b61', 'request_id': 'req-4c16dc27-f910-4f12-afd3-46dd8b907317'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:54.905713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7aacb87b0747d4a56aa8f04fb58b61', 'request_id': 'req-4c16dc27-f910-4f12-afd3-46dd8b907317'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:54.915458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7aacb87b0747d4a56aa8f04fb58b61', 'request_id': 'req-4c16dc27-f910-4f12-afd3-46dd8b907317'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:54.930491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] The token cache is being invalidate because project bb7aacb87b0747d4a56aa8f04fb58b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:54.930915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:54.932046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:54.934193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1116/2234] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:54 2022] DELETE /identity/v3/projects/bb7aacb87b0747d4a56aa8f04fb58b61 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:54.937857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:54.950426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018490de-19da-4da9-ae94-34c88344934b service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:54.978195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:55.033780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:55.035259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:55.035872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:55.036736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] PATH_INFO: `/v3/users/6064551e132348df8a01b2aafa54434c` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:55.038326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6064551e132348df8a01b2aafa54434c)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:55.042520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:55.137884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6064551e132348df8a01b2aafa54434c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.151531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6064551e132348df8a01b2aafa54434c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.153557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6064551e132348df8a01b2aafa54434c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.156585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6064551e132348df8a01b2aafa54434c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.174642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-77ead9f2-da09-4768-a484-84a7e70a35b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6064551e132348df8a01b2aafa54434c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.224580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1119/2235] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:54 2022] DELETE /identity/v3/users/6064551e132348df8a01b2aafa54434c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:55.274191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:55.275768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:55.296156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16dc27-f910-4f12-afd3-46dd8b907317 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:55.420169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:55.421018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:55.421459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:55.421846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] PATH_INFO: `/v3/users/82f2b13a717d426d9e3a2680d9c1f9b0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:55.423764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f2b13a717d426d9e3a2680d9c1f9b0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:55.426077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:55.493007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f2b13a717d426d9e3a2680d9c1f9b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.493703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f2b13a717d426d9e3a2680d9c1f9b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.507308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f2b13a717d426d9e3a2680d9c1f9b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.524137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f2b13a717d426d9e3a2680d9c1f9b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.543116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f2b13a717d426d9e3a2680d9c1f9b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.550915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1117/2236] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:55 2022] DELETE /identity/v3/users/82f2b13a717d426d9e3a2680d9c1f9b0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:55.555454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:55.555841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:55.556197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:55.578248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:55.579636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:55.674212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1120/2237] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:55.684914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:55.686968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:55.788407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1de24-9936-4a47-ad8c-5552ccc9784d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:55.792920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a374315-ee40-4e04-8af7-3e1b4428ba98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:55.793705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374315-ee40-4e04-8af7-3e1b4428ba98 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:55.793976 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374315-ee40-4e04-8af7-3e1b4428ba98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:55.794341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374315-ee40-4e04-8af7-3e1b4428ba98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:55.803955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:55.806188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a374315-ee40-4e04-8af7-3e1b4428ba98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:55.810221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:55.811181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a374315-ee40-4e04-8af7-3e1b4428ba98 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:55.811923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:55.825971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375295-34d6-44aa-ab33-dbb24d3e1bd3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:55.827192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1118/2238] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:55.850073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:55.850830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:55.851388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:55.851672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] PATH_INFO: `/v3/projects/d24beafc81d44c1c837d43428b042071` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:55.853182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24beafc81d44c1c837d43428b042071)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:55.855596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:55.943835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:55.968263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24beafc81d44c1c837d43428b042071', 'request_id': 'req-d810f30b-53a9-403d-93c8-bf8f25239156'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.983910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24beafc81d44c1c837d43428b042071', 'request_id': 'req-d810f30b-53a9-403d-93c8-bf8f25239156'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:55.997713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24beafc81d44c1c837d43428b042071', 'request_id': 'req-d810f30b-53a9-403d-93c8-bf8f25239156'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.011612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] The token cache is being invalidate because project d24beafc81d44c1c837d43428b042071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:56.011955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.012634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d810f30b-53a9-403d-93c8-bf8f25239156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.017523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1121/2239] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:55 2022] DELETE /identity/v3/projects/d24beafc81d44c1c837d43428b042071 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:56.019189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b94b1-6e37-44d3-b8be-3aa3299c1a01 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.019754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b94b1-6e37-44d3-b8be-3aa3299c1a01 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.019975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b94b1-6e37-44d3-b8be-3aa3299c1a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.075753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2c3b94b1-6e37-44d3-b8be-3aa3299c1a01 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:56.079126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c3b94b1-6e37-44d3-b8be-3aa3299c1a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:56.211068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1119/2240] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:56.218927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67811-0275-4849-884d-8aa35a2445ab None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.219620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67811-0275-4849-884d-8aa35a2445ab None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.220141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67811-0275-4849-884d-8aa35a2445ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.278278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-22d67811-0275-4849-884d-8aa35a2445ab None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:56.279864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-22d67811-0275-4849-884d-8aa35a2445ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:56.289856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1122/2241] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:56.293873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b94b1-6e37-44d3-b8be-3aa3299c1a01 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.307939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b94b1-6e37-44d3-b8be-3aa3299c1a01 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.322584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.323567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.323567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.323810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.324533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:56.324842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.327998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.358481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d67811-0275-4849-884d-8aa35a2445ab None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.362419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1120/2242] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:36:56.372590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d67811-0275-4849-884d-8aa35a2445ab None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.398939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.399636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.399988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.401529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.402985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.405941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.483700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1123/2243] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:56 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:56.488636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.503398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca86dfd-cfb9-42ca-ac2b-4dbe22a36029 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.601348 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.602379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.602895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.603275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.604054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.606107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.621562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.623745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:56.640773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5356dc-89db-4349-b107-bd3278a0869f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.646335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.647181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.647590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.647966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] PATH_INFO: `/v3/projects/880aef80c9bf4884829ddbe994bb3713` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.649618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=880aef80c9bf4884829ddbe994bb3713)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.652074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.662190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1121/2244] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:56 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:56.667088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.696016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffb63-df9e-4e7f-83d3-79be77817ff8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.703272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.705609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.705898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.706397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.707487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.709196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.730234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880aef80c9bf4884829ddbe994bb3713', 'request_id': 'req-c1d68a2c-c060-4190-820e-2375c65f92fe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.733695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1122/2245] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:56.734730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.740056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880aef80c9bf4884829ddbe994bb3713', 'request_id': 'req-c1d68a2c-c060-4190-820e-2375c65f92fe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.753017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880aef80c9bf4884829ddbe994bb3713', 'request_id': 'req-c1d68a2c-c060-4190-820e-2375c65f92fe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.754167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b954-0859-4c7d-8ef1-bc2697f0385a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.770147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] The token cache is being invalidate because project 880aef80c9bf4884829ddbe994bb3713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:56.771118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.771831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.779329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1124/2246] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:56 2022] DELETE /identity/v3/projects/880aef80c9bf4884829ddbe994bb3713 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:56.781631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.783789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:56.855548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.856578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.858120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.858583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.859578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.862586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.867167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:56.868155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d68a2c-c060-4190-820e-2375c65f92fe admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.873879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.874846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.875127 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.875921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] PATH_INFO: `/v3/users/3ad4d22a02ac4dfabc263c321c62b96a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.876682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad4d22a02ac4dfabc263c321c62b96a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.878682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.888454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1123/2247] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:36:56.895396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:56.899166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:56.929648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7584da-1666-491e-8025-c47f0ebeb2e5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:56.929855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:56.941757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404b5e5-ab78-41f8-9065-712e68f2a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:56.942816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b5e5-ab78-41f8-9065-712e68f2a5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:56.943085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b5e5-ab78-41f8-9065-712e68f2a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:56.943329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b5e5-ab78-41f8-9065-712e68f2a5d3 admin admin] PATH_INFO: `/v3/projects/f397add234d94842b8461836847275f0/users/f6f0fd233d08446a8e28b7c7145a86f9/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:56.968630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad4d22a02ac4dfabc263c321c62b96a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.969001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404b5e5-ab78-41f8-9065-712e68f2a5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f397add234d94842b8461836847275f0, user_id=f6f0fd233d08446a8e28b7c7145a86f9, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:56.972645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404b5e5-ab78-41f8-9065-712e68f2a5d3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:56.981899 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad4d22a02ac4dfabc263c321c62b96a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.983195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad4d22a02ac4dfabc263c321c62b96a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:56.984596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad4d22a02ac4dfabc263c321c62b96a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:57.011079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1124/2248] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:56 2022] PUT /identity/v3/projects/f397add234d94842b8461836847275f0/users/f6f0fd233d08446a8e28b7c7145a86f9/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:57.011282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad4d22a02ac4dfabc263c321c62b96a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:57.013404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951619e7-7e74-4ea8-985f-ef7a075a7282 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:57.013791 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951619e7-7e74-4ea8-985f-ef7a075a7282 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:57.013975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951619e7-7e74-4ea8-985f-ef7a075a7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:57.038323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1125/2249] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:56 2022] DELETE /identity/v3/users/3ad4d22a02ac4dfabc263c321c62b96a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:57.059381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-951619e7-7e74-4ea8-985f-ef7a075a7282 None None] MFA Rules not processed for user `f6f0fd233d08446a8e28b7c7145a86f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:57.060991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-951619e7-7e74-4ea8-985f-ef7a075a7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:57.171567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1125/2250] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:57.173255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:57.176018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:57.309483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc66bbe-ec32-4692-9e5d-0c96865da068 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:57.315645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:57.316417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:57.316843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:57.317262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:57.318221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:57.320951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:57.387680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1126/2251] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:57 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:57.401404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951619e7-7e74-4ea8-985f-ef7a075a7282 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:57.431957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951619e7-7e74-4ea8-985f-ef7a075a7282 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:57.596519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:57.597160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:57.597446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:57.597724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:57.598628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:57.600511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:57.654724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1126/2252] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:57 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:57.663921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:57.680977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be641-a43d-4bf9-80c1-c24165578969 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:57.694419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:57.695090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:57.695380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:57.695663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:57.696325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:57.698208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:57.729762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:57.730677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1127/2253] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:57.734617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:57.739324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:57.756782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12d55-b1ca-49bc-a535-1f9c9bcbfb8f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:57.761916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5c06e-b0b5-4a0e-aa11-1a9f17ad80d0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:57.762728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:57.763626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:57.764023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:57.764399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] PATH_INFO: `/v3/projects/01ee9a2680b14beb9384e77c3f26d7c5/users/1f96e169fce24dd0838319c5cf065fa1/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:57.769005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:57.770512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:57.771275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:57.771705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] PATH_INFO: `/v3/projects/482a90b405f4447bbfc7d56403f205de` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:57.773080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482a90b405f4447bbfc7d56403f205de)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:57.776167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:57.783316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ee9a2680b14beb9384e77c3f26d7c5, user_id=1f96e169fce24dd0838319c5cf065fa1, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:57.787649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:57.810179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1128/2254] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:57 2022] PUT /identity/v3/projects/01ee9a2680b14beb9384e77c3f26d7c5/users/1f96e169fce24dd0838319c5cf065fa1/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:57.812507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:57.856005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482a90b405f4447bbfc7d56403f205de', 'request_id': 'req-83acfa26-16a6-4850-b994-4298af7fddf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:57.858252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:57.868479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482a90b405f4447bbfc7d56403f205de', 'request_id': 'req-83acfa26-16a6-4850-b994-4298af7fddf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:57.888311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482a90b405f4447bbfc7d56403f205de', 'request_id': 'req-83acfa26-16a6-4850-b994-4298af7fddf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:57.910049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] The token cache is being invalidate because project 482a90b405f4447bbfc7d56403f205de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:36:57.911496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:57.912544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83acfa26-16a6-4850-b994-4298af7fddf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:57.923220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1127/2255] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:36:57 2022] DELETE /identity/v3/projects/482a90b405f4447bbfc7d56403f205de => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:57.924599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d97d-1bc6-49fb-8bfe-2a1d8b20f637 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:57.924884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d97d-1bc6-49fb-8bfe-2a1d8b20f637 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:57.925156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d97d-1bc6-49fb-8bfe-2a1d8b20f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:57.948928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:57.954155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e216d97d-1bc6-49fb-8bfe-2a1d8b20f637 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:57.956122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e216d97d-1bc6-49fb-8bfe-2a1d8b20f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:57.984694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784b61d-266d-4f4b-b8cf-94db5a7a6467 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.049943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1128/2256] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:58.052925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da87530-0757-4f08-b2ab-5fab4c4ac5b7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.054410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da87530-0757-4f08-b2ab-5fab4c4ac5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.055710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da87530-0757-4f08-b2ab-5fab4c4ac5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.085975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2da87530-0757-4f08-b2ab-5fab4c4ac5b7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:58.087482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2da87530-0757-4f08-b2ab-5fab4c4ac5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:58.099062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1129/2257] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:58.104271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da87530-0757-4f08-b2ab-5fab4c4ac5b7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.110058 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.113628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.113768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.114048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.114753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.115718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da87530-0757-4f08-b2ab-5fab4c4ac5b7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.119959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.120904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.121628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.122001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.122416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.123192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:36:58.123868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.125391 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.134205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1129/2258] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:58.138949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.141585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:58.145612 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1130/2259] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:36:58.149818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.167174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01e4c-dbef-4305-bbb2-a9b6aec30c7f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.169832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc8f7-e8be-43f4-a93d-17c66c9eedae admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.174572 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dc189-58b9-4b89-bcdd-a0be1a81dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.175221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc189-58b9-4b89-bcdd-a0be1a81dbe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.175541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc189-58b9-4b89-bcdd-a0be1a81dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.175857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc189-58b9-4b89-bcdd-a0be1a81dbe1 admin admin] PATH_INFO: `/v3/projects/01ee9a2680b14beb9384e77c3f26d7c5/users/1f96e169fce24dd0838319c5cf065fa1/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.178584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dc189-58b9-4b89-bcdd-a0be1a81dbe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ee9a2680b14beb9384e77c3f26d7c5, user_id=1f96e169fce24dd0838319c5cf065fa1, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.178913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.180126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.180613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.181272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.182197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.182304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dc189-58b9-4b89-bcdd-a0be1a81dbe1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.184686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.197629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1130/2260] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:58 2022] PUT /identity/v3/projects/01ee9a2680b14beb9384e77c3f26d7c5/users/1f96e169fce24dd0838319c5cf065fa1/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:36:58.212222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.213118 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.213404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.228501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1131/2261] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:36:58 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:36:58.231497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.259122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] MFA Rules not processed for user `1f96e169fce24dd0838319c5cf065fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:58.261597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:58.326818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c64e4-5140-4c79-b1af-059e1a6bb576 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.333836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.334872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.335259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.335704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.336630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.339392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.365318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1131/2262] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:58.373592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1132/2263] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:36:58 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:36:58.377307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.377458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.378936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:58.390162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2424ec6-dc30-4b28-bbfc-0ed69c92fe2a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.396373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217f4f-c3ac-45c1-bd36-393f5e5651e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.398067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217f4f-c3ac-45c1-bd36-393f5e5651e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.398720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217f4f-c3ac-45c1-bd36-393f5e5651e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.400691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217f4f-c3ac-45c1-bd36-393f5e5651e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.401482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd217f4f-c3ac-45c1-bd36-393f5e5651e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.403152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd217f4f-c3ac-45c1-bd36-393f5e5651e5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.423748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1133/2264] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:58.426340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8890f-bfbc-4401-846c-648732079ee7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.426340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8890f-bfbc-4401-846c-648732079ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.426589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8890f-bfbc-4401-846c-648732079ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.462292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:58.462554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9e3c9-4554-417a-a16a-816d536fd84e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.467675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.467983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3ac8890f-bfbc-4401-846c-648732079ee7 None None] MFA Rules not processed for user `a9a2d9f4d9a0464789c9e761f48a4e68`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:58.468522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.468857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.469155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.469663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ac8890f-bfbc-4401-846c-648732079ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:58.484658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.486603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.510007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1132/2265] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:58.510865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.528495 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518de0-9cab-4eb3-816e-69d3fdab9eeb service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.544218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.545675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.546339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.546833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.547667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.549553 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.551345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:58.563053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1134/2266] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:58.574958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1133/2267] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:36:58.579104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8890f-bfbc-4401-846c-648732079ee7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.582191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.584554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:58.601418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8890f-bfbc-4401-846c-648732079ee7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.611357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfac14-3707-4045-a08f-f35caf01740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.612325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfac14-3707-4045-a08f-f35caf01740a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.613033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfac14-3707-4045-a08f-f35caf01740a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.613701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfac14-3707-4045-a08f-f35caf01740a admin admin] PATH_INFO: `/v3/projects/ecbd901b4c634a43bb4f42647c093bdf/users/985c3c076df44e5b98a7ed74c5fc547f/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.637419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfac14-3707-4045-a08f-f35caf01740a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbd901b4c634a43bb4f42647c093bdf, user_id=985c3c076df44e5b98a7ed74c5fc547f, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:58.642930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfac14-3707-4045-a08f-f35caf01740a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:58.668196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1135/2268] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:36:58 2022] PUT /identity/v3/projects/ecbd901b4c634a43bb4f42647c093bdf/users/985c3c076df44e5b98a7ed74c5fc547f/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:58.679366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.679668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.679949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.721240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d71c1-228c-4f4c-8b6c-980b4182f359 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:58.723809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] MFA Rules not processed for user `985c3c076df44e5b98a7ed74c5fc547f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:58.725602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:58.838767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1136/2269] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:58.872255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:58.872255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:58.872255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:58.872255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:58.914867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:58.916486 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:59.022402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:59.024231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:59.041574 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1134/2270] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:36:59.077860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13c60-07ff-4f9f-87fd-1b2de69f639d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:59.082780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:59.083560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:59.083857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:59.084659 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:59.093771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:59.094824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:59.135231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1137/2271] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:36:59.175264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:59.320769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:59.406537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440687e-c1d9-4e6b-a592-84e24f16d8cd service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:59.433667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:59.434756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:59.436745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:59.437203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] PATH_INFO: `/v3/users/985c3c076df44e5b98a7ed74c5fc547f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:59.440192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=985c3c076df44e5b98a7ed74c5fc547f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:59.451857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:59.474528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:59.508915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e4108-2c94-4708-84f3-1f6cde534d1d service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:36:59.520145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:36:59.520879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:59.521174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:59.521506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] PATH_INFO: `/v3/users/f6f0fd233d08446a8e28b7c7145a86f9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:59.523019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f0fd233d08446a8e28b7c7145a86f9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:36:59.527787 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:36:59.536756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:59.566264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985c3c076df44e5b98a7ed74c5fc547f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.581639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985c3c076df44e5b98a7ed74c5fc547f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.582715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985c3c076df44e5b98a7ed74c5fc547f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.583603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985c3c076df44e5b98a7ed74c5fc547f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.616199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e858ca06-6d2a-4241-b85b-ff8324831aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985c3c076df44e5b98a7ed74c5fc547f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.645909 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f0fd233d08446a8e28b7c7145a86f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.646971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f0fd233d08446a8e28b7c7145a86f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.665431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f0fd233d08446a8e28b7c7145a86f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.679591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1135/2272] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:59 2022] DELETE /identity/v3/users/985c3c076df44e5b98a7ed74c5fc547f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:59.680697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:59.681034 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:59.681340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:59.690891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f0fd233d08446a8e28b7c7145a86f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.727482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0fb6a3ca-5fb1-4e7f-9460-8f94f545cc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f0fd233d08446a8e28b7c7145a86f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:36:59.736299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1138/2273] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:36:59 2022] DELETE /identity/v3/users/f6f0fd233d08446a8e28b7c7145a86f9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:36:59.742867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:59.744145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:59.752728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:36:59.753292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:36:59.753292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:36:59.775672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:36:59.777386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:59.907283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1136/2274] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:36:59.919464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1139/2275] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:36:59.921375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:59.924140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:36:59.933084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:36:59.934827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:00.011791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9062e0-6feb-4dcf-9de2-2682f1e37481 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:00.016562 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:00.017363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:00.018056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:00.018338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:00.027776 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:00.034288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:00.036806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:00.046072 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27fb1b-730a-4c82-a46c-4762c2eecdb4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:00.063926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:00.063926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:00.063926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:00.063926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:00.075040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1137/2276] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:00.081344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:00.083141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:00.099240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1140/2277] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:00.663160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:00.664682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:00.701771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a282f-0b8f-46a5-9f9a-a3b8736c67e7 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:00.701771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:00.701771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:00.701771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:00.702430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] PATH_INFO: `/v3/projects/f397add234d94842b8461836847275f0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:00.702886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f397add234d94842b8461836847275f0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:00.707570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:00.783629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f397add234d94842b8461836847275f0', 'request_id': 'req-83d5865c-8e70-481d-89ed-9dc1e3880ea0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:00.800137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f397add234d94842b8461836847275f0', 'request_id': 'req-83d5865c-8e70-481d-89ed-9dc1e3880ea0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:00.815603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f397add234d94842b8461836847275f0', 'request_id': 'req-83d5865c-8e70-481d-89ed-9dc1e3880ea0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:00.836064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] The token cache is being invalidate because project f397add234d94842b8461836847275f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:00.836426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:00.837338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:00.840212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1138/2278] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:00 2022] DELETE /identity/v3/projects/f397add234d94842b8461836847275f0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:00.845746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:00.862174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ceae1-4000-499e-aa76-bcad6b1fcb59 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:00.900589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:00.985946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:00.986704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:00.987207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:00.987573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] PATH_INFO: `/v3/users/1f96e169fce24dd0838319c5cf065fa1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:00.992983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f96e169fce24dd0838319c5cf065fa1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:00.995862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:01.086559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f96e169fce24dd0838319c5cf065fa1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.087722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f96e169fce24dd0838319c5cf065fa1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.100160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f96e169fce24dd0838319c5cf065fa1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.111489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f96e169fce24dd0838319c5cf065fa1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.129339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f96e169fce24dd0838319c5cf065fa1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.139761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1141/2279] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:00 2022] DELETE /identity/v3/users/1f96e169fce24dd0838319c5cf065fa1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:01.237607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:01.237607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:01.272387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5865c-8e70-481d-89ed-9dc1e3880ea0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:01.400924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:01.402533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:01.403184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:01.403626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] PATH_INFO: `/v3/projects/ecbd901b4c634a43bb4f42647c093bdf` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:01.405115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbd901b4c634a43bb4f42647c093bdf)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:01.409269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:01.485136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:01.486799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:01.498531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbd901b4c634a43bb4f42647c093bdf', 'request_id': 'req-a041c223-8d9c-401b-9b93-b515f54186f7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.508376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbd901b4c634a43bb4f42647c093bdf', 'request_id': 'req-a041c223-8d9c-401b-9b93-b515f54186f7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.537048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbd901b4c634a43bb4f42647c093bdf', 'request_id': 'req-a041c223-8d9c-401b-9b93-b515f54186f7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.560451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] The token cache is being invalidate because project ecbd901b4c634a43bb4f42647c093bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:01.560451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.562008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a041c223-8d9c-401b-9b93-b515f54186f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:01.566856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1139/2280] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:01 2022] DELETE /identity/v3/projects/ecbd901b4c634a43bb4f42647c093bdf => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:01.574210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763b8c-a15b-42f3-8ac5-026469fd2b72 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:01.575498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763b8c-a15b-42f3-8ac5-026469fd2b72 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:01.575498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763b8c-a15b-42f3-8ac5-026469fd2b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:01.603141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:01.609273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6bf8-cd1f-43e0-995a-09f9543d4f05 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:01.621139 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d8763b8c-a15b-42f3-8ac5-026469fd2b72 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:01.624043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d8763b8c-a15b-42f3-8ac5-026469fd2b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:01.692991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:01.697070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:01.697754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:01.697754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:01.700425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:01.747568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:01.781911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1140/2281] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:01.789029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:01.789475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:01.790032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:01.836878 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:01.838445 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:01.862402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1141/2282] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:01.865404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:01.868525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:01.881496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:01.883022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:01.900706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f000789-ca6a-4598-8832-d901f2848091 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:01.903164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1142/2283] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:01.905610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:01.917303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:01.918982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:01.919370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:01.920729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] PATH_INFO: `/v3/projects/01ee9a2680b14beb9384e77c3f26d7c5` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:01.926202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ee9a2680b14beb9384e77c3f26d7c5)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:01.930378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:01.936557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36c0f2-a4ad-4aae-bee7-0a0e60dcf783 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:01.949727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:01.951683 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:01.954045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:01.954516 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:01.955295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:01.956938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:01.967194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.002446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1143/2284] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:02.007036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.028388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad7f95-5673-496b-b997-9ba12ed95c0a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.041494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.044375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.045309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.051200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.052237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.056881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.105743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ee9a2680b14beb9384e77c3f26d7c5', 'request_id': 'req-55deb981-eda7-495a-8a05-4ff1cb01559c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.124620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ee9a2680b14beb9384e77c3f26d7c5', 'request_id': 'req-55deb981-eda7-495a-8a05-4ff1cb01559c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.140818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1144/2285] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:02.145635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.146625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ee9a2680b14beb9384e77c3f26d7c5', 'request_id': 'req-55deb981-eda7-495a-8a05-4ff1cb01559c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.219068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] The token cache is being invalidate because project 01ee9a2680b14beb9384e77c3f26d7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:02.219338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.220051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-55deb981-eda7-495a-8a05-4ff1cb01559c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.225147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1142/2286] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:01 2022] DELETE /identity/v3/projects/01ee9a2680b14beb9384e77c3f26d7c5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:02.227133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61501c9-5030-4801-8651-38b31b843c3a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.227470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61501c9-5030-4801-8651-38b31b843c3a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.227747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61501c9-5030-4801-8651-38b31b843c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.247481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ff80-f7af-4326-9119-a11a95d288ad admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.260748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.261311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.261598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.262027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.264066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.268861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.270864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f61501c9-5030-4801-8651-38b31b843c3a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:02.272611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f61501c9-5030-4801-8651-38b31b843c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:02.299463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1143/2287] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:02.308504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba61e71-ae4d-42e2-9d54-fc6add8e3d00 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.308839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba61e71-ae4d-42e2-9d54-fc6add8e3d00 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.309136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba61e71-ae4d-42e2-9d54-fc6add8e3d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.323804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1145/2288] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:02.326147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.335713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:02.353299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c15b-bc9a-4752-af2b-d9dc9c8c93e1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.359806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.361357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.361556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.361809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.362540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.364940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.367291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1ba61e71-ae4d-42e2-9d54-fc6add8e3d00 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:02.368523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1ba61e71-ae4d-42e2-9d54-fc6add8e3d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:02.377632 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1144/2289] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:02.378453 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1146/2290] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:02.379448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412218-b94b-4b99-876a-17fb7f7b2e50 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.379938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412218-b94b-4b99-876a-17fb7f7b2e50 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.380403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412218-b94b-4b99-876a-17fb7f7b2e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.382156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.396422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cf66b-67da-47f0-8e9f-6be5166ffb74 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.400624 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-93412218-b94b-4b99-876a-17fb7f7b2e50 None None] MFA Rules not processed for user `a9a2d9f4d9a0464789c9e761f48a4e68`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:02.402165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-93412218-b94b-4b99-876a-17fb7f7b2e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:02.403521 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.404237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.404524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.404802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.405513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:02.406093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.409397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.426690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1147/2291] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:02.428165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.441244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9475d2-b117-492b-9444-d0abe7976dcb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.460658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.461913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.462863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.463153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.463818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.465427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.483493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1145/2292] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:02.484522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93412218-b94b-4b99-876a-17fb7f7b2e50 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.491536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1148/2293] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:02.495542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.517282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3031-29c6-4f85-9127-efb8ab86e44a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.523893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93412218-b94b-4b99-876a-17fb7f7b2e50 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.527054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.528141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.528433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.528713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] PATH_INFO: `/v3/projects/4b37f7624d1b4fd69cd6402e5430a766/users/39baed89cf14467cbebb87523a17c8ec/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.536300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.537314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.537606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.537883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.556323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.561967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.580681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b37f7624d1b4fd69cd6402e5430a766, user_id=39baed89cf14467cbebb87523a17c8ec, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.583470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.592257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:02.615216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1146/2294] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:02.616365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.618290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:02.621020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1149/2295] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:02 2022] PUT /identity/v3/projects/4b37f7624d1b4fd69cd6402e5430a766/users/39baed89cf14467cbebb87523a17c8ec/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:02.621948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.636292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:02.717512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603568b-df82-4300-b061-9135a24ae0ae admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.770133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a3a16-53dc-46af-8024-c0e7e1d176b9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:02.776747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.777931 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.778387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.778811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] PATH_INFO: `/v3/users/9bcb207fe32649699cc5567590654e40` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.781063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bcb207fe32649699cc5567590654e40)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.785681 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.818087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbabf4-f713-4cdb-9f2e-7045f549f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:02.819005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbabf4-f713-4cdb-9f2e-7045f549f85f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.819629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbabf4-f713-4cdb-9f2e-7045f549f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.820150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbabf4-f713-4cdb-9f2e-7045f549f85f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.821179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbabf4-f713-4cdb-9f2e-7045f549f85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:02.823418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbabf4-f713-4cdb-9f2e-7045f549f85f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:02.849977 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1150/2296] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:02.852485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88910c87-6c4d-4ef3-b9aa-89ba86219a7f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.852892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88910c87-6c4d-4ef3-b9aa-89ba86219a7f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.853406 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88910c87-6c4d-4ef3-b9aa-89ba86219a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:02.884904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bcb207fe32649699cc5567590654e40'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.903351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-88910c87-6c4d-4ef3-b9aa-89ba86219a7f None None] MFA Rules not processed for user `39baed89cf14467cbebb87523a17c8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:02.904257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bcb207fe32649699cc5567590654e40'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.905313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bcb207fe32649699cc5567590654e40'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.905864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-88910c87-6c4d-4ef3-b9aa-89ba86219a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:02.906295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bcb207fe32649699cc5567590654e40'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.923988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bcb207fe32649699cc5567590654e40'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:02.961605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1147/2297] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:02 2022] DELETE /identity/v3/users/9bcb207fe32649699cc5567590654e40 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:02.961605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:02.961605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:02.993836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1151/2298] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:02.996232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea89ba-cb94-4e14-8a04-cccbc87e89a1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:02.996670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea89ba-cb94-4e14-8a04-cccbc87e89a1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:02.997149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea89ba-cb94-4e14-8a04-cccbc87e89a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:03.021324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e4ea89ba-cb94-4e14-8a04-cccbc87e89a1 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:03.022606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e4ea89ba-cb94-4e14-8a04-cccbc87e89a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:03.075412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e18d-a80f-4fa6-a976-b56b2f60d6c6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:03.082383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:03.083318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:03.083752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:03.084180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:03.085211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:03.088322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:03.090663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:03.107811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1148/2299] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:03.109196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:03.115172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:03.134801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:03.145115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1152/2300] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:03.148853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea89ba-cb94-4e14-8a04-cccbc87e89a1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:03.176483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea89ba-cb94-4e14-8a04-cccbc87e89a1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:03.203689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:03.205018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:03.205312 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:03.205593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:03.207132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:03.209026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:03.236938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1153/2301] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:03.238207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:03.242620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8ef53-0c3a-489c-b491-8e1917928c01 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:03.243599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:03.260652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b5e5-60e5-4878-8341-db57e41c2336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:03.260652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b5e5-60e5-4878-8341-db57e41c2336 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:03.260652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b5e5-60e5-4878-8341-db57e41c2336 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:03.260652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b5e5-60e5-4878-8341-db57e41c2336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:03.333061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9befb79-d9ca-4c67-816f-8bf7016439d9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:03.340724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:03.341365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:03.341653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:03.341930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:03.365971 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:03.368037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:03.389050 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1154/2302] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:03.392069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:03.401797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b5e5-60e5-4878-8341-db57e41c2336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:03.404237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b5e5-60e5-4878-8341-db57e41c2336 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:03.416124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e29ff-0ccf-4518-88bc-4b093a95deab service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:03.432950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:03.433687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:03.433917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:03.434195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] PATH_INFO: `/v3/projects/e013633235e24b0a9b64f07ddf35fd7e/users/3d9172dc313643718a1f093d7b566d75/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:03.458834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1149/2303] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:03.494130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e013633235e24b0a9b64f07ddf35fd7e, user_id=3d9172dc313643718a1f093d7b566d75, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:03.506505 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:03.545584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1155/2304] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:03 2022] PUT /identity/v3/projects/e013633235e24b0a9b64f07ddf35fd7e/users/3d9172dc313643718a1f093d7b566d75/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:03.558993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:03.559810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:03.561091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:03.645180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] MFA Rules not processed for user `3d9172dc313643718a1f093d7b566d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:03.660663 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:03.951461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1150/2305] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:03.966133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:03.970386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:04.095507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767a616-fc9f-494a-aa55-4ab0b313230d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:04.102378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b991-ae12-4733-88d6-2fa1694a198d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:04.103654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b991-ae12-4733-88d6-2fa1694a198d service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:04.104452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b991-ae12-4733-88d6-2fa1694a198d service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:04.104452 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b991-ae12-4733-88d6-2fa1694a198d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:04.116519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234b991-ae12-4733-88d6-2fa1694a198d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:04.118383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234b991-ae12-4733-88d6-2fa1694a198d service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:04.144950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1156/2306] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:04.236355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:04.238288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:04.503045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:04.532184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bf40b-a942-4f6e-9438-becbf822aad3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:04.540172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:04.541423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:04.541906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:04.542550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] PATH_INFO: `/v3/projects/63cdbd29719a4b7c998a3a6af7e6995a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:04.544113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cdbd29719a4b7c998a3a6af7e6995a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:04.547711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:04.676501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cdbd29719a4b7c998a3a6af7e6995a', 'request_id': 'req-716ff62a-c832-4374-ba0c-36d1dbf1c721'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:04.688172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cdbd29719a4b7c998a3a6af7e6995a', 'request_id': 'req-716ff62a-c832-4374-ba0c-36d1dbf1c721'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:04.706321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cdbd29719a4b7c998a3a6af7e6995a', 'request_id': 'req-716ff62a-c832-4374-ba0c-36d1dbf1c721'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:04.731221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] The token cache is being invalidate because project 63cdbd29719a4b7c998a3a6af7e6995a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:04.731522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:04.732193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-716ff62a-c832-4374-ba0c-36d1dbf1c721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:04.734158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1151/2307] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:04 2022] DELETE /identity/v3/projects/63cdbd29719a4b7c998a3a6af7e6995a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:04.738954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e42b1-764a-4f0a-8fc2-59ecc03c8f1b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:04.739267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e42b1-764a-4f0a-8fc2-59ecc03c8f1b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:04.739566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e42b1-764a-4f0a-8fc2-59ecc03c8f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:04.770998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-320e42b1-764a-4f0a-8fc2-59ecc03c8f1b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:04.775370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-320e42b1-764a-4f0a-8fc2-59ecc03c8f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:04.850541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:04.910755 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1157/2308] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:04.918768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716fdf-427b-4795-afb4-7644ae2580cb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:04.919353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716fdf-427b-4795-afb4-7644ae2580cb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:04.920661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716fdf-427b-4795-afb4-7644ae2580cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:04.966746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e3716fdf-427b-4795-afb4-7644ae2580cb None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:04.970594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e3716fdf-427b-4795-afb4-7644ae2580cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:04.991733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1152/2309] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:04.997869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e42b1-764a-4f0a-8fc2-59ecc03c8f1b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:05.046178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e42b1-764a-4f0a-8fc2-59ecc03c8f1b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:05.067215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:05.070803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.071303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.072119 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.074940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:05.075306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:05.077284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:05.101030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1158/2310] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:05.103818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3716fdf-427b-4795-afb4-7644ae2580cb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:05.119059 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3716fdf-427b-4795-afb4-7644ae2580cb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:05.127987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a6d34-06bd-453d-a8a6-e19bdc29e3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:05.129385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6d34-06bd-453d-a8a6-e19bdc29e3ef admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.129803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6d34-06bd-453d-a8a6-e19bdc29e3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.130531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6d34-06bd-453d-a8a6-e19bdc29e3ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.131417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a6d34-06bd-453d-a8a6-e19bdc29e3ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:05.134658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a6d34-06bd-453d-a8a6-e19bdc29e3ef admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:05.199181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1153/2311] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:05 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:05.206152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:05.220458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c611d89-38f8-4c9d-9fec-99f67193415c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:05.380035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:05.381001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.381943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.385896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.389224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:05.395579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:05.410512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bc45f-b163-4ce3-abe5-2b4fdf3e1224 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.411111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bc45f-b163-4ce3-abe5-2b4fdf3e1224 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.411850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bc45f-b163-4ce3-abe5-2b4fdf3e1224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.470744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1159/2312] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:05 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:05.477537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:05.480724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7b0bc45f-b163-4ce3-abe5-2b4fdf3e1224 None None] MFA Rules not processed for user `39baed89cf14467cbebb87523a17c8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:05.483973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b0bc45f-b163-4ce3-abe5-2b4fdf3e1224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:05.495371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d91911-5bb6-478d-b8f4-2ee1547a92d4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:05.501187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:05.501947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.502229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.502571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.503649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:05.506417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:05.525692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1160/2313] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:05.527643 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:05.580079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19267476-7f54-4c36-93cd-84111f2a0de0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:05.586155 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:05.586824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.587145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.587422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.588347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:05.594089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:05.623555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1161/2314] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:05.627445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:05.646306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad153bf-e53d-41f9-a0de-d29ae6db0c61 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:05.666086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:05.666086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.666482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.666705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] PATH_INFO: `/v3/projects/b52d20b86c0442dca57f2306b32224f1/users/f9858a47696a4437a346f0a8452fbc18/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.714585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52d20b86c0442dca57f2306b32224f1, user_id=f9858a47696a4437a346f0a8452fbc18, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:05.740827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:05.752997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1154/2315] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:05.775000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1162/2316] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:05 2022] PUT /identity/v3/projects/b52d20b86c0442dca57f2306b32224f1/users/f9858a47696a4437a346f0a8452fbc18/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:05.786166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f3cd-2e67-4983-b255-cf345791e868 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:05.786571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f3cd-2e67-4983-b255-cf345791e868 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:05.787197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f3cd-2e67-4983-b255-cf345791e868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:05.856433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0ac2f3cd-2e67-4983-b255-cf345791e868 None None] MFA Rules not processed for user `f9858a47696a4437a346f0a8452fbc18`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:05.858891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0ac2f3cd-2e67-4983-b255-cf345791e868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:05.978050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:06.039616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1155/2317] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:06.044660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:06.161076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73463171-c68a-4328-be53-f2b71885cfe5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:06.165980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:06.166682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.167040 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.167314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.167968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:06.170324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:06.207884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:06.219832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2f3cd-2e67-4983-b255-cf345791e868 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:06.227925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1163/2318] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:06 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:06.233535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2f3cd-2e67-4983-b255-cf345791e868 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:06.320115 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:06.320737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.321015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.321308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.322186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:06.324761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:06.348936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1156/2319] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:06 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:06.352739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:06.368500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9bd06-c776-4502-978d-a6c004357236 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:06.373913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:06.377062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.377062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.377062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.377062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:06.381854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:06.400095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1164/2320] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:06.404300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:06.419622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9d9a-bf20-4f91-99b1-4fca2061df3e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:06.426534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:06.427219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.427498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.427768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] PATH_INFO: `/v3/projects/e7d96013cf2c46a2ab1aa5fc1d1edcd9/users/9cbbc27281da4a69aec7f88891ff0105/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.446044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d96013cf2c46a2ab1aa5fc1d1edcd9, user_id=9cbbc27281da4a69aec7f88891ff0105, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:06.449156 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:06.478252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1157/2321] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:06 2022] PUT /identity/v3/projects/e7d96013cf2c46a2ab1aa5fc1d1edcd9/users/9cbbc27281da4a69aec7f88891ff0105/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:06.482523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:06.493714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0049-652d-4fa7-aa28-51243f30df45 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:06.566157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d0cbd-c91c-4144-a596-d0efef04415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:06.567713 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0cbd-c91c-4144-a596-d0efef04415b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.568001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0cbd-c91c-4144-a596-d0efef04415b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.568364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0cbd-c91c-4144-a596-d0efef04415b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.569052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d0cbd-c91c-4144-a596-d0efef04415b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:06.571060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d0cbd-c91c-4144-a596-d0efef04415b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:06.587250 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1165/2322] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:06.591054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:06.602629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b594-3e99-4a38-9f2f-d6240e4afea1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:06.609882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:06.614560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.614830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.615137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] PATH_INFO: `/v3/projects/e7d96013cf2c46a2ab1aa5fc1d1edcd9/users/9cbbc27281da4a69aec7f88891ff0105/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.623212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d96013cf2c46a2ab1aa5fc1d1edcd9, user_id=9cbbc27281da4a69aec7f88891ff0105, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:06.625425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:06.644542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1158/2323] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:06 2022] PUT /identity/v3/projects/e7d96013cf2c46a2ab1aa5fc1d1edcd9/users/9cbbc27281da4a69aec7f88891ff0105/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:06.655901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.656256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.656600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.688267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] MFA Rules not processed for user `9cbbc27281da4a69aec7f88891ff0105`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:06.690885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:06.777809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1166/2324] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:06.789912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:06.792629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:06.897718 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d10aac-f6ab-4ff6-acfd-3242f80c2bed admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:06.903128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96b57e-904d-4bd2-9b0a-d363f10cdec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:06.903792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b57e-904d-4bd2-9b0a-d363f10cdec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:06.904346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b57e-904d-4bd2-9b0a-d363f10cdec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:06.904565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b57e-904d-4bd2-9b0a-d363f10cdec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:06.984476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:06.988727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b57e-904d-4bd2-9b0a-d363f10cdec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:06.990661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b57e-904d-4bd2-9b0a-d363f10cdec7 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:07.007535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1159/2325] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:08.011393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:08.012884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:08.086489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c301d1-f756-4cc3-9f25-babd5c0bdcbc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:08.091033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:08.091687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:08.091963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:08.092237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] PATH_INFO: `/v3/users/250156465af64d80bb625a10ae7fe2b1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:08.093387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=250156465af64d80bb625a10ae7fe2b1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:08.095377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:08.107766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:08.162364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250156465af64d80bb625a10ae7fe2b1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:08.163035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250156465af64d80bb625a10ae7fe2b1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:08.175908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250156465af64d80bb625a10ae7fe2b1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:08.189134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250156465af64d80bb625a10ae7fe2b1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:08.205326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250156465af64d80bb625a10ae7fe2b1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:08.212046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1167/2326] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:08 2022] DELETE /identity/v3/users/250156465af64d80bb625a10ae7fe2b1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:08.216846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:08.217336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:08.217452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:08.247398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:08.248756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:08.315300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1160/2327] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:08.325515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:08.327555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:08.447141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c720-160f-43fd-92a0-79655bf77cf5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:08.452000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0e17-de57-4805-8309-a1ed32be7f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:08.452798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0e17-de57-4805-8309-a1ed32be7f6c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:08.453227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0e17-de57-4805-8309-a1ed32be7f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:08.453650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0e17-de57-4805-8309-a1ed32be7f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:08.470694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0e17-de57-4805-8309-a1ed32be7f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:08.473053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0e17-de57-4805-8309-a1ed32be7f6c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:08.487273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1168/2328] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:09.073100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.075781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:09.093518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594848b-c7f2-4930-a03f-baf8383de9d0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:09.101441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:09.102177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.102558 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.102915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] PATH_INFO: `/v3/projects/c73b1d1ffb3d4afbb9da6244fdaffaa0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.105230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73b1d1ffb3d4afbb9da6244fdaffaa0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:09.107874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:09.231673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73b1d1ffb3d4afbb9da6244fdaffaa0', 'request_id': 'req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:09.240491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73b1d1ffb3d4afbb9da6244fdaffaa0', 'request_id': 'req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:09.252485 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73b1d1ffb3d4afbb9da6244fdaffaa0', 'request_id': 'req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:09.272416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] The token cache is being invalidate because project c73b1d1ffb3d4afbb9da6244fdaffaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:09.272833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:09.273589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7411ff3d-0e33-4a47-8f70-9c12ea0a7c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:09.275502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1161/2329] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:09 2022] DELETE /identity/v3/projects/c73b1d1ffb3d4afbb9da6244fdaffaa0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:09.280368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e313cd-2859-42ad-94f8-8f8f9df79440 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.280840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e313cd-2859-42ad-94f8-8f8f9df79440 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.281041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e313cd-2859-42ad-94f8-8f8f9df79440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.307295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b4e313cd-2859-42ad-94f8-8f8f9df79440 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:09.308903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4e313cd-2859-42ad-94f8-8f8f9df79440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:09.376892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1169/2330] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:09.384490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495773-197f-4f63-92d3-c8bacb363523 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.384785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495773-197f-4f63-92d3-c8bacb363523 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.385068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495773-197f-4f63-92d3-c8bacb363523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.418977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b5495773-197f-4f63-92d3-c8bacb363523 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:09.420738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b5495773-197f-4f63-92d3-c8bacb363523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:09.429567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1162/2331] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:09.433926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e313cd-2859-42ad-94f8-8f8f9df79440 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.444760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e313cd-2859-42ad-94f8-8f8f9df79440 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:09.475462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:09.476934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.477217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.477491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.478323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:09.478865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:09.484096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:09.510388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1170/2332] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:09.512522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5495773-197f-4f63-92d3-c8bacb363523 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.522288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5495773-197f-4f63-92d3-c8bacb363523 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:09.527253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:09.527856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.528133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.528409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.529048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:09.530987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:09.562873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1163/2333] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:09 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:09.564555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.575849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b567c5-c971-4276-aaa7-09e0b5571cb4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:09.595870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:09.655523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:09.666480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.666480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.666480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.666480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:09.666480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:09.692732 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1171/2334] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:09 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:09.693904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.710636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d4f1a-b83b-4e33-b41a-091738c517fd admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:09.730126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:09.730795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.731080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.731362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.732026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:09.733719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:09.744510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1164/2335] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:09.748798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.760032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a9b07-0517-47f2-94ae-b8267143751d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:09.765440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdba30-e130-439f-a936-08521dec5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:09.766057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdba30-e130-439f-a936-08521dec5732 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.766337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdba30-e130-439f-a936-08521dec5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.767171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdba30-e130-439f-a936-08521dec5732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.767816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdba30-e130-439f-a936-08521dec5732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:09.769669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdba30-e130-439f-a936-08521dec5732 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:09.785673 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1172/2336] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:09.791128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.802805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11bc28-25ca-4f85-ab32-df0a51698902 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:09.809192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:09.810173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.810687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.811161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] PATH_INFO: `/v3/projects/a363af0e80a84fca8b77635aafdf97e7/users/dfe0224809ec4f34bf44df929a09d2d3/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.845336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a363af0e80a84fca8b77635aafdf97e7, user_id=dfe0224809ec4f34bf44df929a09d2d3, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:09.848980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:09.876945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1165/2337] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:09 2022] PUT /identity/v3/projects/a363af0e80a84fca8b77635aafdf97e7/users/dfe0224809ec4f34bf44df929a09d2d3/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:09.879913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcffd-383f-4121-9ab3-6013fbe946a6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:09.880204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcffd-383f-4121-9ab3-6013fbe946a6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:09.880481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcffd-383f-4121-9ab3-6013fbe946a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:09.919418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-725dcffd-383f-4121-9ab3-6013fbe946a6 None None] MFA Rules not processed for user `dfe0224809ec4f34bf44df929a09d2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:09.921183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-725dcffd-383f-4121-9ab3-6013fbe946a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:09.971934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:09.973882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:10.001430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:10.050719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1173/2338] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:10.051665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcffd-383f-4121-9ab3-6013fbe946a6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:10.085123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55d9e4-3e5f-4db5-b7b6-53246444756f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.092006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.092730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.093040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.094025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] PATH_INFO: `/v3/users/f9858a47696a4437a346f0a8452fbc18` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.095721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9858a47696a4437a346f0a8452fbc18)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.098641 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:10.174101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcffd-383f-4121-9ab3-6013fbe946a6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.180527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.181926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.182464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.183638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.184981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.188229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9858a47696a4437a346f0a8452fbc18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:10.189407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:10.206291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9858a47696a4437a346f0a8452fbc18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:10.207203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9858a47696a4437a346f0a8452fbc18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:10.207976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9858a47696a4437a346f0a8452fbc18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:10.219826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7bc740d-6e2a-43c9-bf6a-1fa8a24b2512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9858a47696a4437a346f0a8452fbc18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:10.232963 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1174/2339] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:10.233895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:10.237310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:10.246692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1166/2340] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:09 2022] DELETE /identity/v3/users/f9858a47696a4437a346f0a8452fbc18 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:10.248248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.248537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.248811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.276411 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:10.295074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:10.296411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:10.408607 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1167/2341] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:10.416551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:10.418099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:10.438207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb8128-c751-4836-b65b-88c3b2279e80 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.449111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.450091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.450751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.451186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.452751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.456188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:10.483300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:10.523029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1175/2342] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:10 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:10.526939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:10.540198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9715c-1472-46f8-a009-2279eb36a544 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.547275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.548563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.548822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.549173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.550013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.551889 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:10.557510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d1dd-42ed-4c04-b936-9caf89f41359 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.561884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.564978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1176/2343] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:10.568208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.568501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.568785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.570036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:10.579952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.581419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:10.584027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaacba8-db5f-4f48-8215-668f0716be64 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.589730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c9ae9-4924-4761-9407-5bb99c3f8033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.590894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9ae9-4924-4761-9407-5bb99c3f8033 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.591403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9ae9-4924-4761-9407-5bb99c3f8033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.591882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9ae9-4924-4761-9407-5bb99c3f8033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.592717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c9ae9-4924-4761-9407-5bb99c3f8033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.593692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1168/2344] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:10.595537 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c9ae9-4924-4761-9407-5bb99c3f8033 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:10.609961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1177/2345] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:10.614897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:10.625311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1368-fe2d-411e-9a81-27ea58694c63 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.630936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.631684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.631981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.632334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] PATH_INFO: `/v3/projects/6c093df3e7c746299ec786bbbf4a390e/users/85917d5fd2284168b944f5056784f42f/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.654158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c093df3e7c746299ec786bbbf4a390e, user_id=85917d5fd2284168b944f5056784f42f, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.656983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:10.709195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1169/2346] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:10 2022] PUT /identity/v3/projects/6c093df3e7c746299ec786bbbf4a390e/users/85917d5fd2284168b944f5056784f42f/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:10.721546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.721904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.722369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.764017 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] MFA Rules not processed for user `85917d5fd2284168b944f5056784f42f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:10.765306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:10.867553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1178/2347] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:10.872660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:10.967354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7948-351a-46dc-8c29-0471bdf23564 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:10.974328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:10.975089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:10.975460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:10.975721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:10.976425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:10.978676 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.022169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.022870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:11.053169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1170/2348] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:10 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:11.055646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4feb1-860d-4eb1-8682-3a7cd923f008 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:11.056855 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.184223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a990342-6f0a-4e71-8bbe-f1d1f60133ba admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:11.189194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:11.190561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.191340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.192156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] PATH_INFO: `/v3/projects/b52d20b86c0442dca57f2306b32224f1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.193317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:11.193790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52d20b86c0442dca57f2306b32224f1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:11.194212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.194532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.194954 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.195739 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:11.196536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.198230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.211916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:11.248452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1171/2349] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:11 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:11.253881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.278150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52d20b86c0442dca57f2306b32224f1', 'request_id': 'req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.291337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52d20b86c0442dca57f2306b32224f1', 'request_id': 'req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.295839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456f8fc-b247-4f39-a62a-fcbe11c653cc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:11.304113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52d20b86c0442dca57f2306b32224f1', 'request_id': 'req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.329197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] The token cache is being invalidate because project b52d20b86c0442dca57f2306b32224f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:11.329737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.330692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.333176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1179/2350] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:11 2022] DELETE /identity/v3/projects/b52d20b86c0442dca57f2306b32224f1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:11.337952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.342926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:11.346577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:11.405573 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:11.406557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.407617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.408221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.409205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:11.411078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.432088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1172/2351] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:11.436549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.439806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:11.459494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535406eb-1d27-47f7-961b-9a74b3f287f9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:11.462874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fc9e-929e-44c4-a76f-103dee9ec8c4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:11.474834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:11.477861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.478268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.478669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] PATH_INFO: `/v3/users/9cbbc27281da4a69aec7f88891ff0105` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.483527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:11.483795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbbc27281da4a69aec7f88891ff0105)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:11.485069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.485431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.485767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] PATH_INFO: `/v3/projects/5214e065d8804bd1b862fd200ca16947/users/f6aa5c2300f34027b8fb23d3cbb9f8ad/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.486252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.509249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5214e065d8804bd1b862fd200ca16947, user_id=f6aa5c2300f34027b8fb23d3cbb9f8ad, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:11.513052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.538831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1173/2352] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:11 2022] PUT /identity/v3/projects/5214e065d8804bd1b862fd200ca16947/users/f6aa5c2300f34027b8fb23d3cbb9f8ad/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:11.545195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.584428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbbc27281da4a69aec7f88891ff0105'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.586149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbbc27281da4a69aec7f88891ff0105'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.601202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbbc27281da4a69aec7f88891ff0105'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.614294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbbc27281da4a69aec7f88891ff0105'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.651637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbbc27281da4a69aec7f88891ff0105'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:11.657602 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f79eb-358a-4abd-b9d3-ae424ec27713 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:11.660694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1180/2353] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:11 2022] DELETE /identity/v3/users/9cbbc27281da4a69aec7f88891ff0105 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:11.665289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2145c9e-8c83-48a9-ad85-a2342a4dce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:11.665917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2145c9e-8c83-48a9-ad85-a2342a4dce5b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.666197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2145c9e-8c83-48a9-ad85-a2342a4dce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.666510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2145c9e-8c83-48a9-ad85-a2342a4dce5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.667206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2145c9e-8c83-48a9-ad85-a2342a4dce5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:11.668868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2145c9e-8c83-48a9-ad85-a2342a4dce5b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.680956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1174/2354] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:11.684996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.686473 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:11.720639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:11.785552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc362-d112-4c97-89f0-82bc57cbd2d8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:11.791186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:11.791998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.792385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.792763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] PATH_INFO: `/v3/projects/5214e065d8804bd1b862fd200ca16947/users/f6aa5c2300f34027b8fb23d3cbb9f8ad/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.794947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5214e065d8804bd1b862fd200ca16947, user_id=f6aa5c2300f34027b8fb23d3cbb9f8ad, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:11.798586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:11.809968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1181/2355] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:11 2022] PUT /identity/v3/projects/5214e065d8804bd1b862fd200ca16947/users/f6aa5c2300f34027b8fb23d3cbb9f8ad/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:11.821080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:11.821367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:11.821903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:11.851961 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] MFA Rules not processed for user `f6aa5c2300f34027b8fb23d3cbb9f8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:11.853232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:11.925942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1175/2356] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:11.937245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:11.939948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:12.003386 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa81d2a-2e7b-4568-b7e1-6484a861935a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:12.006969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96470c3c-5b77-4b42-92d2-7dff810b609b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:12.007581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96470c3c-5b77-4b42-92d2-7dff810b609b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:12.007863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96470c3c-5b77-4b42-92d2-7dff810b609b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:12.008146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96470c3c-5b77-4b42-92d2-7dff810b609b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:12.009917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-96470c3c-5b77-4b42-92d2-7dff810b609b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:12.084656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96470c3c-5b77-4b42-92d2-7dff810b609b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:12.086230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96470c3c-5b77-4b42-92d2-7dff810b609b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:12.096793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1182/2357] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:12.814837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:12.816377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:12.865431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:12.968547 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5f575-cc9b-406f-a404-1eae7bd070b8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:12.976082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:12.976082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:12.976082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:12.976082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] PATH_INFO: `/v3/projects/e7d96013cf2c46a2ab1aa5fc1d1edcd9` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:12.977674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d96013cf2c46a2ab1aa5fc1d1edcd9)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:12.979677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:13.040593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d96013cf2c46a2ab1aa5fc1d1edcd9', 'request_id': 'req-e1f08f32-ce15-402c-8369-3a1a15cabcde'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:13.049287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d96013cf2c46a2ab1aa5fc1d1edcd9', 'request_id': 'req-e1f08f32-ce15-402c-8369-3a1a15cabcde'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:13.058805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d96013cf2c46a2ab1aa5fc1d1edcd9', 'request_id': 'req-e1f08f32-ce15-402c-8369-3a1a15cabcde'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:13.073479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] The token cache is being invalidate because project e7d96013cf2c46a2ab1aa5fc1d1edcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:13.073791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:13.074837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e1f08f32-ce15-402c-8369-3a1a15cabcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:13.076621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1176/2358] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:12 2022] DELETE /identity/v3/projects/e7d96013cf2c46a2ab1aa5fc1d1edcd9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:13.082018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a339eb1-3507-4078-b026-9572f99e5c80 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.082626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a339eb1-3507-4078-b026-9572f99e5c80 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.082626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a339eb1-3507-4078-b026-9572f99e5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.104902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7a339eb1-3507-4078-b026-9572f99e5c80 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:13.121534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7a339eb1-3507-4078-b026-9572f99e5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:13.283152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1183/2359] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:13.291033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b1cb-fbb0-4f64-a94a-44ca9760c878 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.291335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b1cb-fbb0-4f64-a94a-44ca9760c878 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.291600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b1cb-fbb0-4f64-a94a-44ca9760c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.339850 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-30b9b1cb-fbb0-4f64-a94a-44ca9760c878 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:13.341348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-30b9b1cb-fbb0-4f64-a94a-44ca9760c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:13.375257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1177/2360] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:13.379665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a339eb1-3507-4078-b026-9572f99e5c80 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:13.395088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a339eb1-3507-4078-b026-9572f99e5c80 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:13.406202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:13.406905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.407261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.407590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.408256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:13.408559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:13.413613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:13.421423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:13.436854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1184/2361] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:13.443299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b1cb-fbb0-4f64-a94a-44ca9760c878 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:13.456237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b1cb-fbb0-4f64-a94a-44ca9760c878 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:13.461684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:13.462327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.462637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.462975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.463637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:13.465719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:13.510531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1178/2362] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:13 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:13.515789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:13.529388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82fa3e-4a28-4113-9c80-b459a064943d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:13.608802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:13.609428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.609712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.609986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.610700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:13.612654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:13.640286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1185/2363] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:13 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:13.644903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:13.663433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7282dc-7321-4522-bf9b-d9d337458fce admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:13.669721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:13.670561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.670934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.671515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.672384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:13.674944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:13.690122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1179/2364] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:13.691439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:13.706048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6336e6d-48a7-4577-b3c0-7cc53b1d75af admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:13.716369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:13.717154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.717533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.717921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.718707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:13.721509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:13.738410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1186/2365] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:13.740536 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:13.756797 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c313-bbda-4229-8663-f0bd334a29c1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:13.764262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75f6db-3985-4a31-bc2b-9717f31c4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:13.764816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75f6db-3985-4a31-bc2b-9717f31c4b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.765083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75f6db-3985-4a31-bc2b-9717f31c4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.765528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75f6db-3985-4a31-bc2b-9717f31c4b11 admin admin] PATH_INFO: `/v3/projects/c37cb40856f446d29ee61ede04ffd144/users/107a7db380bc494781cad0a5d1e0d982/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.789175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75f6db-3985-4a31-bc2b-9717f31c4b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37cb40856f446d29ee61ede04ffd144, user_id=107a7db380bc494781cad0a5d1e0d982, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:13.792597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75f6db-3985-4a31-bc2b-9717f31c4b11 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:13.795222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:13.797290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:13.810057 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1180/2366] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:13 2022] PUT /identity/v3/projects/c37cb40856f446d29ee61ede04ffd144/users/107a7db380bc494781cad0a5d1e0d982/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:13.825939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:13.826719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:13.827003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:13.869201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] MFA Rules not processed for user `107a7db380bc494781cad0a5d1e0d982`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:13.870679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:13.894396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147069-cce1-4c98-a508-f68c4f75193f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:13.924304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:13.978278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1181/2367] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:14.002880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:14.004591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:14.007101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:14.008117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:14.008998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:14.009456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:14.012246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:14.025418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1926b-fbae-4439-a41d-41eb63eea75f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:14.036098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:14.036819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:14.037106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:14.037378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:14.047498 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:14.049583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:14.059266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1182/2368] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:14.090219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:14.107468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:14.108914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:14.118546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1187/2369] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:14.856424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:14.866382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f699af6-df96-4b9a-90e3-0194728fe107 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:14.871079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5724-f795-4e0e-8a9f-7faf0e98ac1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:14.871688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5724-f795-4e0e-8a9f-7faf0e98ac1a service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:14.871969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5724-f795-4e0e-8a9f-7faf0e98ac1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:14.872242 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5724-f795-4e0e-8a9f-7faf0e98ac1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:14.874050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d4cb5724-f795-4e0e-8a9f-7faf0e98ac1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:14.958221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5724-f795-4e0e-8a9f-7faf0e98ac1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:14.959870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5724-f795-4e0e-8a9f-7faf0e98ac1a service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:14.975875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1183/2370] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:17.496682 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:17.592339 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7bde5-80f9-46ce-b468-900aa5e7d7e9 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:17.598774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:17.599524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:17.599867 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:17.600251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] PATH_INFO: `/v3/users/107a7db380bc494781cad0a5d1e0d982` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:17.601435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107a7db380bc494781cad0a5d1e0d982)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:17.603476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:17.671085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107a7db380bc494781cad0a5d1e0d982'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:17.673618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107a7db380bc494781cad0a5d1e0d982'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:17.683695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107a7db380bc494781cad0a5d1e0d982'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:17.693073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107a7db380bc494781cad0a5d1e0d982'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:17.709274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107a7db380bc494781cad0a5d1e0d982'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:17.718293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1188/2371] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:17 2022] DELETE /identity/v3/users/107a7db380bc494781cad0a5d1e0d982 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:17.720561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:17.721029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:17.721139 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:17.740449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:17.741679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:17.826534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1184/2372] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:17.833313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:17.834883 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:17.909647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2424-bdcd-4e14-811f-62b27e0ff1d4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:17.916780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89cace-e8fc-470b-98f7-6671b2d6d666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:17.917497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89cace-e8fc-470b-98f7-6671b2d6d666 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:17.917812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89cace-e8fc-470b-98f7-6671b2d6d666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:17.918150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89cace-e8fc-470b-98f7-6671b2d6d666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:17.928792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89cace-e8fc-470b-98f7-6671b2d6d666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:17.930316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89cace-e8fc-470b-98f7-6671b2d6d666 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:17.941468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1189/2373] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:18.305279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:18.307820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:18.343221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f018-6646-4001-a86f-a1d59853ad1d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:18.365028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:18.366686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.367391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.368215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] PATH_INFO: `/v3/projects/c37cb40856f446d29ee61ede04ffd144` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.372532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37cb40856f446d29ee61ede04ffd144)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:18.374540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:18.442898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37cb40856f446d29ee61ede04ffd144', 'request_id': 'req-bd53cf87-c744-46c6-bb3d-c69fc5d904de'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:18.449737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37cb40856f446d29ee61ede04ffd144', 'request_id': 'req-bd53cf87-c744-46c6-bb3d-c69fc5d904de'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:18.451844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:18.460433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37cb40856f446d29ee61ede04ffd144', 'request_id': 'req-bd53cf87-c744-46c6-bb3d-c69fc5d904de'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:18.473528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] The token cache is being invalidate because project c37cb40856f446d29ee61ede04ffd144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:18.473735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:18.474388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bd53cf87-c744-46c6-bb3d-c69fc5d904de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:18.475910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1185/2374] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:18 2022] DELETE /identity/v3/projects/c37cb40856f446d29ee61ede04ffd144 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:18.481034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb825d-4cd7-447e-a4f1-22d2bd6dc572 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.481777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb825d-4cd7-447e-a4f1-22d2bd6dc572 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.482260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb825d-4cd7-447e-a4f1-22d2bd6dc572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.500540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:18.508823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a6cb825d-4cd7-447e-a4f1-22d2bd6dc572 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:18.510962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6cb825d-4cd7-447e-a4f1-22d2bd6dc572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:18.579288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1190/2375] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:18.587130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6504d-3192-49ac-95d2-9132a575232d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.587422 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6504d-3192-49ac-95d2-9132a575232d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.587704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6504d-3192-49ac-95d2-9132a575232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.608027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-60e6504d-3192-49ac-95d2-9132a575232d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:18.609257 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-60e6504d-3192-49ac-95d2-9132a575232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:18.618415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1186/2376] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:18.622802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb825d-4cd7-447e-a4f1-22d2bd6dc572 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:18.633184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb825d-4cd7-447e-a4f1-22d2bd6dc572 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:18.638091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:18.638806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.639159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.639506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.640337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:18.640804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:18.643654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:18.669790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1191/2377] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:18.674339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6504d-3192-49ac-95d2-9132a575232d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:18.686626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6504d-3192-49ac-95d2-9132a575232d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:18.693010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:18.693802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.694091 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.694507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.695404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:18.697655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:18.731439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1187/2378] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:18 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:18.732829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:18.744592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3009e2-f3a5-49c6-871e-5ed8df4b00c7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:18.805552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:18.806076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.806396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.806672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.807330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:18.809347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:18.836475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1192/2379] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:18 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:18.837746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:18.849664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97550ba-e450-499a-ad0e-ed988039c0f9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:18.854600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:18.855515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.856033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.856384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.857122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:18.858870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:18.870405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1188/2380] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:18.874941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:18.887184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd0b4f-31d5-4b51-bb8b-8f43f5f95781 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:18.892620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42eb7-ab90-4453-a1d0-8da8acf682a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:18.893251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42eb7-ab90-4453-a1d0-8da8acf682a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.893535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42eb7-ab90-4453-a1d0-8da8acf682a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.893809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42eb7-ab90-4453-a1d0-8da8acf682a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.894515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42eb7-ab90-4453-a1d0-8da8acf682a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:18.896153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42eb7-ab90-4453-a1d0-8da8acf682a0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:18.908761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1193/2381] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:18.913199 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:18.924252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bdd2-37b8-4270-b841-bbfb31973c1d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:18.929434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:18.930105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.930420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.930706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] PATH_INFO: `/v3/projects/dc208cfce7e44afcb9d1102a50e22d1c/users/03a8f6c4aa5e41ac98452f57e2b722e7/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:18.947003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc208cfce7e44afcb9d1102a50e22d1c, user_id=03a8f6c4aa5e41ac98452f57e2b722e7, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:18.949675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:18.963956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1189/2382] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:18 2022] PUT /identity/v3/projects/dc208cfce7e44afcb9d1102a50e22d1c/users/03a8f6c4aa5e41ac98452f57e2b722e7/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:18.974278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae291b-4cfc-4fbb-a0d1-4f3ba4f3f40a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:18.974617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae291b-4cfc-4fbb-a0d1-4f3ba4f3f40a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:18.974903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae291b-4cfc-4fbb-a0d1-4f3ba4f3f40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.010712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ebae291b-4cfc-4fbb-a0d1-4f3ba4f3f40a None None] MFA Rules not processed for user `03a8f6c4aa5e41ac98452f57e2b722e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:19.011953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ebae291b-4cfc-4fbb-a0d1-4f3ba4f3f40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:19.060247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:19.062319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:19.090760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1194/2383] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:19.091824 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae291b-4cfc-4fbb-a0d1-4f3ba4f3f40a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:19.099187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:19.160640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497f95-0000-4b06-9476-ec87c7a20e60 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:19.165753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:19.166414 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.166694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.166967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] PATH_INFO: `/v3/users/dfe0224809ec4f34bf44df929a09d2d3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.168107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe0224809ec4f34bf44df929a09d2d3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:19.170048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:19.188826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae291b-4cfc-4fbb-a0d1-4f3ba4f3f40a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:19.195481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:19.197383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.197774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.198240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.199267 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:19.203180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:19.230766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe0224809ec4f34bf44df929a09d2d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:19.250489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe0224809ec4f34bf44df929a09d2d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:19.251412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe0224809ec4f34bf44df929a09d2d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:19.252281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe0224809ec4f34bf44df929a09d2d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:19.262189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-24c3976c-91b4-481c-9c58-81470b7c7b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe0224809ec4f34bf44df929a09d2d3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:19.269493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1195/2384] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:19 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:19.273699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:19.278666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:19.280894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=4,keystone:DELETE=13,keystone:SELECT=83 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:19.295554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1190/2385] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:19 2022] DELETE /identity/v3/users/dfe0224809ec4f34bf44df929a09d2d3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:19.300290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.300605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.300858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.325892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:19.327161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:19.374016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2b0ba-5f79-43c9-84af-179598afac01 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:19.436214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1191/2386] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:19.449146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:19.452557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:19.456247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:19.456874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.457587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.457980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.458840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:19.461766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:19.504151 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1196/2387] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:19 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:19.509129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:19.535728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c1f7-1487-4509-9c80-f87e616e7bc4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:19.541141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:19.541975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.542457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.543442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.544292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:19.547025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:19.560416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1197/2388] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:19.564951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:19.588178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f15ed-f759-46ea-bfed-631930577f74 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:19.597674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:19.598490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.598814 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.599118 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.600024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:19.602674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:19.608517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094feab-f304-4149-b23a-091bee86fb04 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:19.617024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1198/2389] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:19.621253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:19.622025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c71ba-9d5d-4e44-9b0f-3f8e894f0904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:19.622709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c71ba-9d5d-4e44-9b0f-3f8e894f0904 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.622997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c71ba-9d5d-4e44-9b0f-3f8e894f0904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.623280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c71ba-9d5d-4e44-9b0f-3f8e894f0904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.628261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:19.637703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e63f7e-d370-4f81-876f-9bac01ab44d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:19.642809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:19.643491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.643774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.643986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c71ba-9d5d-4e44-9b0f-3f8e894f0904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:19.644092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] PATH_INFO: `/v3/projects/f66d3d2f0e20416eac77d0c64e363601/users/41dd6047126041dea5ef0c58c316a2bc/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.645475 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c71ba-9d5d-4e44-9b0f-3f8e894f0904 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:19.660404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1192/2390] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:19.671456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66d3d2f0e20416eac77d0c64e363601, user_id=41dd6047126041dea5ef0c58c316a2bc, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:19.675019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:19.699454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1199/2391] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:19 2022] PUT /identity/v3/projects/f66d3d2f0e20416eac77d0c64e363601/users/41dd6047126041dea5ef0c58c316a2bc/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:19.711890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a236-9e0a-4425-8794-648b8ec6d362 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:19.711890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a236-9e0a-4425-8794-648b8ec6d362 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:19.712205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a236-9e0a-4425-8794-648b8ec6d362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:19.768487 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ad10a236-9e0a-4425-8794-648b8ec6d362 None None] MFA Rules not processed for user `41dd6047126041dea5ef0c58c316a2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:19.770036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ad10a236-9e0a-4425-8794-648b8ec6d362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:19.912977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1193/2392] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:19.917054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.045658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba38c5-5214-4890-a712-6699d087689b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.057778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.058531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.058815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.059090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.059878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.062035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.126493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1200/2393] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:19 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:20.127069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10a236-9e0a-4425-8794-648b8ec6d362 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.137952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.143609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:20.146606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10a236-9e0a-4425-8794-648b8ec6d362 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.227696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:20.269039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.269798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.270085 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.270378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.271060 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.273340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.290161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217648f5-eac3-4fd4-b8d2-c9c63505e350 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.302811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.303789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.305143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.305868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] PATH_INFO: `/v3/projects/a363af0e80a84fca8b77635aafdf97e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.308278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a363af0e80a84fca8b77635aafdf97e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.318135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1194/2394] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:20 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:20.318955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.319102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.330822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f2ac8-1128-42ab-b4d9-3492f7828f2c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.337195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.337825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.338110 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.338428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.339096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.340727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.353143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1195/2395] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:20.357176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.370417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b887-9c5b-48c2-91c1-d107ba03a956 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.377873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.378636 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.378912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.379195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] PATH_INFO: `/v3/projects/e352f57ae548476fbfd36fcdd470544b/users/b68a9235ed6843e88aef470868b07d50/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.405193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e352f57ae548476fbfd36fcdd470544b, user_id=b68a9235ed6843e88aef470868b07d50, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.405517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a363af0e80a84fca8b77635aafdf97e7', 'request_id': 'req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.408666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.413596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a363af0e80a84fca8b77635aafdf97e7', 'request_id': 'req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.422947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a363af0e80a84fca8b77635aafdf97e7', 'request_id': 'req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.428918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:20.434261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1196/2396] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:20 2022] PUT /identity/v3/projects/e352f57ae548476fbfd36fcdd470544b/users/b68a9235ed6843e88aef470868b07d50/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:20.436014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.440363 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] The token cache is being invalidate because project a363af0e80a84fca8b77635aafdf97e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:20.440870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.442013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.447635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1201/2397] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:20 2022] DELETE /identity/v3/projects/a363af0e80a84fca8b77635aafdf97e7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:20.449523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.451102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:20.526222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baa201-4e0b-4b78-ada3-2f68ff942fe4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.532027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.533066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.533190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.533521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.534458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.536171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.541723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbfaee-e6f8-45e0-8418-12b6c0fedee1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.546739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.547189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1197/2398] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:20.547415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.547704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.547979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] PATH_INFO: `/v3/users/85917d5fd2284168b944f5056784f42f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.549191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85917d5fd2284168b944f5056784f42f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.551196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.551648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.554951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:20.575279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccffd9e-413b-4fd3-afda-57d05c13d67c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.582047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96e88a-9699-47bb-be91-f89a6792dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.583015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e88a-9699-47bb-be91-f89a6792dba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.583509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e88a-9699-47bb-be91-f89a6792dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.583895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e88a-9699-47bb-be91-f89a6792dba4 admin admin] PATH_INFO: `/v3/projects/e352f57ae548476fbfd36fcdd470544b/users/b68a9235ed6843e88aef470868b07d50/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.586402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96e88a-9699-47bb-be91-f89a6792dba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e352f57ae548476fbfd36fcdd470544b, user_id=b68a9235ed6843e88aef470868b07d50, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.590700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96e88a-9699-47bb-be91-f89a6792dba4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:20.610649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1198/2399] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:20 2022] PUT /identity/v3/projects/e352f57ae548476fbfd36fcdd470544b/users/b68a9235ed6843e88aef470868b07d50/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:20.616643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.617039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.618394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.619542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85917d5fd2284168b944f5056784f42f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.620649 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85917d5fd2284168b944f5056784f42f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.630300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85917d5fd2284168b944f5056784f42f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.640587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85917d5fd2284168b944f5056784f42f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.655440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] MFA Rules not processed for user `b68a9235ed6843e88aef470868b07d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:20.656352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85917d5fd2284168b944f5056784f42f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:20.657387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:20.664195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1202/2400] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:20 2022] DELETE /identity/v3/users/85917d5fd2284168b944f5056784f42f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:20.734292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:20.759320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1199/2401] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:20.774515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:20.776302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:20.882612 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b195c-6289-4275-b3a8-9024da8b1418 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:20.886331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:20.887038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:20.887327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:20.887601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:20.889729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:20.921218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:20.988712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:20.991180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:21.003397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1203/2402] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:21.366394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:21.367454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:21.518128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7557eb8-7f99-47f5-8598-4bffe61300bd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:21.667042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:21.668179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:21.668628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:21.670585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] PATH_INFO: `/v3/projects/6c093df3e7c746299ec786bbbf4a390e` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:21.671886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c093df3e7c746299ec786bbbf4a390e)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:21.675258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:21.752820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c093df3e7c746299ec786bbbf4a390e', 'request_id': 'req-9644663e-545d-4f63-aee4-3c37d60bb577'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:21.762331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c093df3e7c746299ec786bbbf4a390e', 'request_id': 'req-9644663e-545d-4f63-aee4-3c37d60bb577'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:21.774925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c093df3e7c746299ec786bbbf4a390e', 'request_id': 'req-9644663e-545d-4f63-aee4-3c37d60bb577'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:21.793707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] The token cache is being invalidate because project 6c093df3e7c746299ec786bbbf4a390e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:21.794405 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:21.795362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:21.798727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1200/2403] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:21 2022] DELETE /identity/v3/projects/6c093df3e7c746299ec786bbbf4a390e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:21.804629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:21.822384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39eec-a36f-42a1-bf2c-818fdca9b18b service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:21.921844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:21.923347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:21.923796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:21.924196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] PATH_INFO: `/v3/users/f6aa5c2300f34027b8fb23d3cbb9f8ad` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:21.925957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6aa5c2300f34027b8fb23d3cbb9f8ad)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:21.928169 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:21.996116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6aa5c2300f34027b8fb23d3cbb9f8ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:21.996931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6aa5c2300f34027b8fb23d3cbb9f8ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.010459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6aa5c2300f34027b8fb23d3cbb9f8ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.018925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6aa5c2300f34027b8fb23d3cbb9f8ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.033512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7c880905-0c35-472d-b154-0d2e2fdbfb23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6aa5c2300f34027b8fb23d3cbb9f8ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.039609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1204/2404] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:21 2022] DELETE /identity/v3/users/f6aa5c2300f34027b8fb23d3cbb9f8ad => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:22.343874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.346489 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:22.371903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644663e-545d-4f63-aee4-3c37d60bb577 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.418999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:22.455395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.456042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.456327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.456605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] PATH_INFO: `/v3/projects/5214e065d8804bd1b862fd200ca16947` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.457734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5214e065d8804bd1b862fd200ca16947)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:22.459781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:22.510969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5214e065d8804bd1b862fd200ca16947', 'request_id': 'req-79693623-28f5-4608-876a-9a24e40b9e14'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.517204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5214e065d8804bd1b862fd200ca16947', 'request_id': 'req-79693623-28f5-4608-876a-9a24e40b9e14'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.525302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5214e065d8804bd1b862fd200ca16947', 'request_id': 'req-79693623-28f5-4608-876a-9a24e40b9e14'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.536727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] The token cache is being invalidate because project 5214e065d8804bd1b862fd200ca16947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:22.537021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.537657 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-79693623-28f5-4608-876a-9a24e40b9e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:22.540933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1201/2405] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:22 2022] DELETE /identity/v3/projects/5214e065d8804bd1b862fd200ca16947 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:22.545762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f3938-8eed-44d3-85b5-e7c23af382a2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.546269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f3938-8eed-44d3-85b5-e7c23af382a2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.546768 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f3938-8eed-44d3-85b5-e7c23af382a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.568598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-697f3938-8eed-44d3-85b5-e7c23af382a2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:22.569872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-697f3938-8eed-44d3-85b5-e7c23af382a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:22.617833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:22.639156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1205/2406] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:22.647294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ffdac-0447-401f-b199-eff7816fe407 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.647585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ffdac-0447-401f-b199-eff7816fe407 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.647866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ffdac-0447-401f-b199-eff7816fe407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.668824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6c7ffdac-0447-401f-b199-eff7816fe407 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:22.670119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6c7ffdac-0447-401f-b199-eff7816fe407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:22.682203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1202/2407] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:22.683404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f3938-8eed-44d3-85b5-e7c23af382a2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.693417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f3938-8eed-44d3-85b5-e7c23af382a2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.698707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.699321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.699604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.699880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.700524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:22.700830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:22.702458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:22.717558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1206/2408] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:22.718724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ffdac-0447-401f-b199-eff7816fe407 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.731652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ffdac-0447-401f-b199-eff7816fe407 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.737062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.737648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.737925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.738197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.738851 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:22.740747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:22.759290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.761016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:22.773007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1203/2409] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:22 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:22.774244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.820955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aadcd-2e07-496a-84a3-aa4ea88b1157 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.839880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ec0a6-62e4-4c27-a80b-4aa6c0f1e781 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.845197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.845799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.846074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.846360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.847000 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:22.848922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:22.874317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1204/2410] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:22 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:22.875066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493fdb-cf5f-475e-8567-c576a6e4d049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.875066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493fdb-cf5f-475e-8567-c576a6e4d049 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.875066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493fdb-cf5f-475e-8567-c576a6e4d049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.875066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493fdb-cf5f-475e-8567-c576a6e4d049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.876262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-63493fdb-cf5f-475e-8567-c576a6e4d049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:22.877386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.888380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b8bc9-a8fd-468f-a215-ad3de5c08944 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.894512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.895121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.895408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.895677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.896509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:22.898217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:22.911216 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1205/2411] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:22.915298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.927274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd394-8f1f-4819-9a4e-95db75d40cd5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.934108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.934700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.934984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.936043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:22.936711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:22.938502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:22.944928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:22.952070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1206/2412] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:22.955541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493fdb-cf5f-475e-8567-c576a6e4d049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:22.956938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:22.957375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493fdb-cf5f-475e-8567-c576a6e4d049 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:22.969018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61573cb7-a7cf-4b74-a0de-b0cb17f54e77 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:22.970664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1207/2413] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:22.976814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:22.977633 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:22.977976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:22.978317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] PATH_INFO: `/v3/projects/f5c5b94360954d8d966b0fa835250fe7/users/ee5155851ed84896a1bb12e0e9a3d3e9/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:23.002189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c5b94360954d8d966b0fa835250fe7, user_id=ee5155851ed84896a1bb12e0e9a3d3e9, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:23.005429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:23.023161 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1207/2414] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:22 2022] PUT /identity/v3/projects/f5c5b94360954d8d966b0fa835250fe7/users/ee5155851ed84896a1bb12e0e9a3d3e9/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:23.034550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870f096-5a7c-4aad-843f-5365dfcc7ba1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:23.034869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870f096-5a7c-4aad-843f-5365dfcc7ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:23.035116 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870f096-5a7c-4aad-843f-5365dfcc7ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:23.081719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c870f096-5a7c-4aad-843f-5365dfcc7ba1 None None] MFA Rules not processed for user `ee5155851ed84896a1bb12e0e9a3d3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:23.083048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c870f096-5a7c-4aad-843f-5365dfcc7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:23.127065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:23.166396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1208/2415] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:23.346021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:23.348303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:23.427204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be36-d22b-45f5-a736-1a95202e27c0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:23.431803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:23.432305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:23.432606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:23.432889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:23.443016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:23.444780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:23.455177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1208/2416] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:23.482997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870f096-5a7c-4aad-843f-5365dfcc7ba1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:23.568736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870f096-5a7c-4aad-843f-5365dfcc7ba1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:23.573772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:23.574328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:23.574633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:23.575011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] PATH_INFO: `/v3/users/ee5155851ed84896a1bb12e0e9a3d3e9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:23.576048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5155851ed84896a1bb12e0e9a3d3e9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:23.579449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:23.620357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:23.639575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16daf-ceb6-41b6-8f5f-90642be3ad32 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:23.644484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5155851ed84896a1bb12e0e9a3d3e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:23.645155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:23.645335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5155851ed84896a1bb12e0e9a3d3e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:23.646281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:23.646815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:23.647458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:23.651166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:23.657599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5155851ed84896a1bb12e0e9a3d3e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:23.669084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5155851ed84896a1bb12e0e9a3d3e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:23.694927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcd9e8ff-7c52-4e19-b1fc-d988d31f8842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5155851ed84896a1bb12e0e9a3d3e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:23.702328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1209/2417] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:23 2022] DELETE /identity/v3/users/ee5155851ed84896a1bb12e0e9a3d3e9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:23.706973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:23.707357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:23.707701 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:23.731601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:23.732838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:23.756269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:23.757866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:23.771255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1209/2418] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:23.794502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:23.822947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1210/2419] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:23.833824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:23.835450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:23.899433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0011af7-d7ee-4145-8d94-cdb44ed35424 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:23.926166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:23.952654 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31761727-0f89-4326-a130-d816591e678d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:23.953195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761727-0f89-4326-a130-d816591e678d service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:23.953477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761727-0f89-4326-a130-d816591e678d service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:23.954287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761727-0f89-4326-a130-d816591e678d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:23.963525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761727-0f89-4326-a130-d816591e678d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:23.965038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761727-0f89-4326-a130-d816591e678d service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:23.976670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1210/2420] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:24.357103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:24.358596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:24.377236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac2afa-978c-4c44-9a10-e584311a0ee7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:24.383143 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:24.383780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.384060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.384331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] PATH_INFO: `/v3/projects/f5c5b94360954d8d966b0fa835250fe7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.385459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c5b94360954d8d966b0fa835250fe7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:24.387415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:24.436283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c5b94360954d8d966b0fa835250fe7', 'request_id': 'req-95590732-a0aa-4d6c-837f-6352fce9aa15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:24.442632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c5b94360954d8d966b0fa835250fe7', 'request_id': 'req-95590732-a0aa-4d6c-837f-6352fce9aa15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:24.450338 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c5b94360954d8d966b0fa835250fe7', 'request_id': 'req-95590732-a0aa-4d6c-837f-6352fce9aa15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:24.461600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] The token cache is being invalidate because project f5c5b94360954d8d966b0fa835250fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:24.461832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:24.462520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-95590732-a0aa-4d6c-837f-6352fce9aa15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:24.464009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1211/2421] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:24 2022] DELETE /identity/v3/projects/f5c5b94360954d8d966b0fa835250fe7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:24.468775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd425b-a110-49c8-8c7c-a29efa46162f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.469902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd425b-a110-49c8-8c7c-a29efa46162f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.469902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd425b-a110-49c8-8c7c-a29efa46162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.489014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-74fd425b-a110-49c8-8c7c-a29efa46162f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:24.490232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-74fd425b-a110-49c8-8c7c-a29efa46162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:24.551066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1211/2422] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:24.558874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaabeb-4a4e-453c-9692-847390efd99d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.559164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaabeb-4a4e-453c-9692-847390efd99d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.559468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaabeb-4a4e-453c-9692-847390efd99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.580700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0abaabeb-4a4e-453c-9692-847390efd99d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:24.581983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0abaabeb-4a4e-453c-9692-847390efd99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:24.590681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1212/2423] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:24.595122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd425b-a110-49c8-8c7c-a29efa46162f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:24.605174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd425b-a110-49c8-8c7c-a29efa46162f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:24.609786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:24.610446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.610725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.610995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.611634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:24.611938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:24.613520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:24.628655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1212/2424] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:24.629717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaabeb-4a4e-453c-9692-847390efd99d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:24.639921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaabeb-4a4e-453c-9692-847390efd99d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:24.645506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:24.646104 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.646408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.646688 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.647325 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:24.649208 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:24.677509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1213/2425] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:24 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:24.681782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:24.692534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255f996-7c44-48ce-86e6-489e55c1ddd6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:24.750699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:24.751502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.751690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.752399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.752952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:24.754996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:24.777929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1213/2426] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:24 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:24.787656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:24.799813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37d858-467f-47b9-bd88-06428ab6195b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:24.804874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:24.805483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.806700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.806981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.807783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:24.809435 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:24.823940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1214/2427] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:24.825240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:24.848315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017fef0-7992-4db0-b2ab-4a641b453de4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:24.863810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bb50a-64fd-4242-9f98-9d07a9149cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:24.865418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb50a-64fd-4242-9f98-9d07a9149cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.866304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb50a-64fd-4242-9f98-9d07a9149cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.871043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb50a-64fd-4242-9f98-9d07a9149cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.871957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bb50a-64fd-4242-9f98-9d07a9149cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:24.873863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bb50a-64fd-4242-9f98-9d07a9149cf5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:24.898389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1214/2428] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:24.902644 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:24.914943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469e3b6-af25-43c2-82f3-307956d8556e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:24.940012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:24.940893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:24.941180 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:24.941450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] PATH_INFO: `/v3/projects/cd6ddb036f184e3da7c7d398fa8cc84b/users/9f616231be374dcc8b3a2cdcf6af08a5/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:24.965730 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6ddb036f184e3da7c7d398fa8cc84b, user_id=9f616231be374dcc8b3a2cdcf6af08a5, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:24.968999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:24.994674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1215/2429] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:24 2022] PUT /identity/v3/projects/cd6ddb036f184e3da7c7d398fa8cc84b/users/9f616231be374dcc8b3a2cdcf6af08a5/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:25.008345 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:25.008630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:25.009092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:25.075643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] MFA Rules not processed for user `9f616231be374dcc8b3a2cdcf6af08a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:25.077285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:25.120347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:25.192737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1215/2430] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:25.212698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:25.216739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:25.332341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a5d2-0e7e-4f95-8660-21dcdaf99aea admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:25.337542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:25.338393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:25.338565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:25.338837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:25.350366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:25.352211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:25.389566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1216/2431] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:26.391939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:26.394407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:26.466287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45975d8-7b3c-4b32-a3a2-31ca0d8a13f7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:26.471628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:26.472268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:26.472545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:26.472816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] PATH_INFO: `/v3/users/1aa177a7da8e4bd092fbf9015afbcee3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:26.473950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa177a7da8e4bd092fbf9015afbcee3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:26.475911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:26.533927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa177a7da8e4bd092fbf9015afbcee3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:26.542732 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa177a7da8e4bd092fbf9015afbcee3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:26.545103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa177a7da8e4bd092fbf9015afbcee3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:26.545753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa177a7da8e4bd092fbf9015afbcee3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:26.553135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa177a7da8e4bd092fbf9015afbcee3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:26.572129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1216/2432] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:26 2022] DELETE /identity/v3/users/1aa177a7da8e4bd092fbf9015afbcee3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:26.846720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:26.861907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f48ef-0066-43f8-a48a-46a5dc45a45a service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:26.877955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:26.939138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:26.939787 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:26.940074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:26.940351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] PATH_INFO: `/v3/projects/5252c94df9d745eeaf07a7c3cea952a9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:26.941491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5252c94df9d745eeaf07a7c3cea952a9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:26.943457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:26.998881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5252c94df9d745eeaf07a7c3cea952a9', 'request_id': 'req-e8ae43fa-a767-4cda-9e08-4b688f00a291'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.005642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5252c94df9d745eeaf07a7c3cea952a9', 'request_id': 'req-e8ae43fa-a767-4cda-9e08-4b688f00a291'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.013482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5252c94df9d745eeaf07a7c3cea952a9', 'request_id': 'req-e8ae43fa-a767-4cda-9e08-4b688f00a291'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.025754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] The token cache is being invalidate because project 5252c94df9d745eeaf07a7c3cea952a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:27.026204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.026899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.028426 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1217/2433] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:26 2022] DELETE /identity/v3/projects/5252c94df9d745eeaf07a7c3cea952a9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:27.033680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.035384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:27.048437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac879d-4935-4303-8484-c146f21f7746 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.114787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:27.147461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.148231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.148512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.148787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] PATH_INFO: `/v3/users/f7084d664c224e4795ded4ab368e8699` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.150185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7084d664c224e4795ded4ab368e8699)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:27.152208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:27.207214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7084d664c224e4795ded4ab368e8699'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.220455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7084d664c224e4795ded4ab368e8699'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.221189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7084d664c224e4795ded4ab368e8699'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.221856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7084d664c224e4795ded4ab368e8699'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.229980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69186183-79b3-476f-ae9d-f8409a87d352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7084d664c224e4795ded4ab368e8699'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.251913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1217/2434] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:27 2022] DELETE /identity/v3/users/f7084d664c224e4795ded4ab368e8699 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:27.433263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.434842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:27.448764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae43fa-a767-4cda-9e08-4b688f00a291 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.508284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.508891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.509176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.509480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] PATH_INFO: `/v3/projects/dfa55925f1984d7b9d645e12d61fc45f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.510658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa55925f1984d7b9d645e12d61fc45f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:27.512586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:27.562876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:27.564562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa55925f1984d7b9d645e12d61fc45f', 'request_id': 'req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.572858 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa55925f1984d7b9d645e12d61fc45f', 'request_id': 'req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.580716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa55925f1984d7b9d645e12d61fc45f', 'request_id': 'req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.591562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] The token cache is being invalidate because project dfa55925f1984d7b9d645e12d61fc45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:27.591849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.592466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f3e1df13-ff82-494e-b0fc-9cb29e6f18bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:27.594744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1218/2435] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:27 2022] DELETE /identity/v3/projects/dfa55925f1984d7b9d645e12d61fc45f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:27.599887 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aecf9b-1813-48b2-a5db-f2217fdc9dd8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.600369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aecf9b-1813-48b2-a5db-f2217fdc9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.600486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aecf9b-1813-48b2-a5db-f2217fdc9dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.622617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-34aecf9b-1813-48b2-a5db-f2217fdc9dd8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:27.623900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-34aecf9b-1813-48b2-a5db-f2217fdc9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:27.681815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.682218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.682600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.687707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1218/2436] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:27.695153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcc06b-7fd1-4617-ad22-8e91d81b9d69 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.695453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcc06b-7fd1-4617-ad22-8e91d81b9d69 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.695705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcc06b-7fd1-4617-ad22-8e91d81b9d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.704210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:27.706663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:27.715449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a1fcc06b-7fd1-4617-ad22-8e91d81b9d69 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:27.716628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a1fcc06b-7fd1-4617-ad22-8e91d81b9d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:27.725680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1219/2437] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:27.729370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcc06b-7fd1-4617-ad22-8e91d81b9d69 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.738668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcc06b-7fd1-4617-ad22-8e91d81b9d69 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.743277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.743864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.744139 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.744409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.745046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:27.745353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:27.746970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:27.759456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1220/2438] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:27.763481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.763606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1219/2439] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:27.774430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7397fd-ab24-4783-902d-607b7e79bc6a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.779650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.780460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.780913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.781441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.782196 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:27.784230 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:27.806596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.807994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:27.812590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1221/2440] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:27 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:27.817237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.845735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:27.887963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7a6ff-2727-4f56-84b8-f144c2dc6ab1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.894668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc59e-3273-44f6-8dc1-86144e2cd498 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.895424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.896147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.896522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.896930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.897653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:27.900051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:27.929644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1222/2441] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:27 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:27.932841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.951882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2b2fc-dcb0-4602-854f-72a62865816c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.957221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.957826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.958106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.958419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.959128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:27.960730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:27.972329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1223/2442] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:27.976769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:27.988344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee997-5094-4407-bb5d-75e7b7151e58 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:27.989075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.990127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.990630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.991047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.994617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:27.995269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:27.995575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:27.996083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:27.996831 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:27.998653 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.011640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1224/2443] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:28.012408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.014111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:28.023973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:28.028030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6f42c-fb75-41f0-9e1c-f4f5c30c1e12 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.034694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.035370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.035687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.035964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] PATH_INFO: `/v3/users/03a8f6c4aa5e41ac98452f57e2b722e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.037283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a8f6c4aa5e41ac98452f57e2b722e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.039985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.064735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.066557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.075576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1220/2444] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:37:28.076517 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.090030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769e265-db92-4ce7-913d-5d9703404739 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.095414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537d3db-d5ea-473a-a582-eb031f68a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.096387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537d3db-d5ea-473a-a582-eb031f68a304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.096625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537d3db-d5ea-473a-a582-eb031f68a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.101941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537d3db-d5ea-473a-a582-eb031f68a304 admin admin] PATH_INFO: `/v3/projects/9a59f5554f3b4ae1a9e5a489211bee88/users/5c6f177a61414bfa8b31e278f2315c6d/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.110715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a8f6c4aa5e41ac98452f57e2b722e7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:28.122896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537d3db-d5ea-473a-a582-eb031f68a304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a59f5554f3b4ae1a9e5a489211bee88, user_id=5c6f177a61414bfa8b31e278f2315c6d, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.124363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a8f6c4aa5e41ac98452f57e2b722e7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:28.125094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a8f6c4aa5e41ac98452f57e2b722e7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:28.126474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537d3db-d5ea-473a-a582-eb031f68a304 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.127258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a8f6c4aa5e41ac98452f57e2b722e7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:28.149600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1221/2445] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:28 2022] PUT /identity/v3/projects/9a59f5554f3b4ae1a9e5a489211bee88/users/5c6f177a61414bfa8b31e278f2315c6d/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:28.166381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d29e2a22-83a7-441e-bd02-cce7ccab304d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a8f6c4aa5e41ac98452f57e2b722e7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:28.167089 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.167581 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.167853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.210479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1225/2446] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:28 2022] DELETE /identity/v3/users/03a8f6c4aa5e41ac98452f57e2b722e7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:28.212277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.212570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.212843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.218794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] MFA Rules not processed for user `5c6f177a61414bfa8b31e278f2315c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:28.221329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:28.273700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:28.275563 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:28.356568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1222/2447] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:28.357812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.360471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:28.367774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1226/2448] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:28.378660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.379227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdd1ae-0fbc-46cc-b458-1ef23babb64b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.380706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:28.388372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.389003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.389282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.389555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.393202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.393202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.394657 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:28.442796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1223/2449] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:28 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:28.445895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.543972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746f402-15d2-4163-9139-22d48b4ba532 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.545282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f63aee-922d-4247-9343-bf4a7e4b26e3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.551358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.552448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.553199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.553401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.554916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.558647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.584471 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:28.600919 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1224/2450] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:28 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:28.604972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.620214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7ff9-dce2-41dd-9adb-13e9d898cb89 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.639440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.640202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.640688 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.641226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.641952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.644164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.647376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.648354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.648618 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.649007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.671351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.671351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.671531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1225/2451] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:28.677280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.693352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1227/2452] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:28.693818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728c54-734f-43dc-b647-88d83b3e2168 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.701045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.702264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.702797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.703454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] PATH_INFO: `/v3/projects/2bcddfdada31429f96e21e2372bd7ae9/users/2cdf65130e7349b380907d5c2e0d40a3/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.728895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bcddfdada31429f96e21e2372bd7ae9, user_id=2cdf65130e7349b380907d5c2e0d40a3, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.732859 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.770292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1226/2453] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:28 2022] PUT /identity/v3/projects/2bcddfdada31429f96e21e2372bd7ae9/users/2cdf65130e7349b380907d5c2e0d40a3/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:28.771169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.788271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46778de0-a3e5-44aa-bbed-bb11a54bfd05 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.893743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5466d-48dd-46bf-b7fe-51a8b0a008e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.894459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5466d-48dd-46bf-b7fe-51a8b0a008e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.894804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5466d-48dd-46bf-b7fe-51a8b0a008e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.895069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5466d-48dd-46bf-b7fe-51a8b0a008e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.896639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5466d-48dd-46bf-b7fe-51a8b0a008e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.897993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5466d-48dd-46bf-b7fe-51a8b0a008e0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.914394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1228/2454] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:28.916602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:28.928955 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af702c-71e8-4c89-83ae-5fc9a44620be admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:28.935804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd648e3-ea7a-49af-a8ba-259ee60f0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:28.936613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd648e3-ea7a-49af-a8ba-259ee60f0801 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.937095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd648e3-ea7a-49af-a8ba-259ee60f0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.937458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd648e3-ea7a-49af-a8ba-259ee60f0801 admin admin] PATH_INFO: `/v3/projects/2bcddfdada31429f96e21e2372bd7ae9/users/2cdf65130e7349b380907d5c2e0d40a3/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:28.939891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd648e3-ea7a-49af-a8ba-259ee60f0801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bcddfdada31429f96e21e2372bd7ae9, user_id=2cdf65130e7349b380907d5c2e0d40a3, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:28.943295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd648e3-ea7a-49af-a8ba-259ee60f0801 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:28.959032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1227/2455] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:28 2022] PUT /identity/v3/projects/2bcddfdada31429f96e21e2372bd7ae9/users/2cdf65130e7349b380907d5c2e0d40a3/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:28.972655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:28.972944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:28.973988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:29.024015 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:29.024389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:29.024605 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:29.031538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] MFA Rules not processed for user `2cdf65130e7349b380907d5c2e0d40a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:29.033290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:29.056845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:29.059347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:29.101716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:29.125646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1228/2456] 10.222.0.52 () {58 vars in 967 bytes} [Sun Sep 25 04:37:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:29.127271 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:29.128233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1229/2457] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:29.128813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:29.143486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:29.145394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:29.207961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2d52d-145d-422d-97c5-f63aa3e5882f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:29.211238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c25e-ae17-43cb-be16-b88a0ec7683f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:29.212670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:29.213305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:29.213587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:29.213863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] PATH_INFO: `/v3/projects/dc208cfce7e44afcb9d1102a50e22d1c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:29.215006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:29.215139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc208cfce7e44afcb9d1102a50e22d1c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:29.215609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:29.215892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:29.216170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:29.217055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:29.276238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc208cfce7e44afcb9d1102a50e22d1c', 'request_id': 'req-a03b3c10-a3bb-4a08-98e9-d787aa88e417'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.282701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:29.283273 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc208cfce7e44afcb9d1102a50e22d1c', 'request_id': 'req-a03b3c10-a3bb-4a08-98e9-d787aa88e417'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.284108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:29.285943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:29.292066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc208cfce7e44afcb9d1102a50e22d1c', 'request_id': 'req-a03b3c10-a3bb-4a08-98e9-d787aa88e417'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.293913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1230/2458] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:29.294848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:29.296385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:29.310740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] The token cache is being invalidate because project dc208cfce7e44afcb9d1102a50e22d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:29.311039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.311979 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.314396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1229/2459] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:29 2022] DELETE /identity/v3/projects/dc208cfce7e44afcb9d1102a50e22d1c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:29.318219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:29.319853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:29.377838 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3e13-e25a-4a7d-b53d-5a165aef7484 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:29.393117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b3c10-a3bb-4a08-98e9-d787aa88e417 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:29.398432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:29.399073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:29.399350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:29.399622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] PATH_INFO: `/v3/users/41dd6047126041dea5ef0c58c316a2bc` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:29.403037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dd6047126041dea5ef0c58c316a2bc)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:29.405205 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:29.421835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:29.445780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:29.446462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:29.446988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:29.447236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:29.449077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:29.469852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dd6047126041dea5ef0c58c316a2bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.470822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dd6047126041dea5ef0c58c316a2bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.481012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dd6047126041dea5ef0c58c316a2bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.488815 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dd6047126041dea5ef0c58c316a2bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.502054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-06dfa145-cf03-4ac3-a200-652b8e9bed62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dd6047126041dea5ef0c58c316a2bc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:29.509513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1230/2460] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:29 2022] DELETE /identity/v3/users/41dd6047126041dea5ef0c58c316a2bc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:29.523330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:29.525178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:29.535365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1231/2461] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:37:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:37:29.971641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:29.972259 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:29.972487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:29.995059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:29.996508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:30.010040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:30.022045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fe2d0-42c0-4e04-b5c6-c2b1119fb325 service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:30.068727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1231/2462] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:37:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:30.081510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:30.083034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:30.094365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:30.096656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:30.097415 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:30.097707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:30.097969 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] PATH_INFO: `/v3/projects/f66d3d2f0e20416eac77d0c64e363601` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:30.099254 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66d3d2f0e20416eac77d0c64e363601)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:30.101255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:30.150690 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66d3d2f0e20416eac77d0c64e363601', 'request_id': 'req-991455c1-e6a7-4f42-b9cb-f503ee11044e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.158462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66d3d2f0e20416eac77d0c64e363601', 'request_id': 'req-991455c1-e6a7-4f42-b9cb-f503ee11044e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.158838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb89c8-051c-4708-9754-244cb313da80 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:30.167178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66d3d2f0e20416eac77d0c64e363601', 'request_id': 'req-991455c1-e6a7-4f42-b9cb-f503ee11044e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.179054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] The token cache is being invalidate because project f66d3d2f0e20416eac77d0c64e363601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:30.179546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.180286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.181794 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1232/2463] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:30 2022] DELETE /identity/v3/projects/f66d3d2f0e20416eac77d0c64e363601 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:30.185508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:30.187005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:30.202379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:30.231749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:30.233095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:30.233503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:30.233783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:30.236260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:30.266385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991455c1-e6a7-4f42-b9cb-f503ee11044e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:30.271693 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:30.272397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:30.272700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:30.272975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] PATH_INFO: `/v3/users/b68a9235ed6843e88aef470868b07d50` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:30.274278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68a9235ed6843e88aef470868b07d50)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:30.276468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:30.306898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:30.308960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:30.320916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1232/2464] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:37:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 04:37:30.334805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68a9235ed6843e88aef470868b07d50'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.343173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68a9235ed6843e88aef470868b07d50'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.343870 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68a9235ed6843e88aef470868b07d50'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.345458 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68a9235ed6843e88aef470868b07d50'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.353665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef1756d6-244d-463f-b99c-53468f90ce22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68a9235ed6843e88aef470868b07d50'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.376253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1233/2465] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:30 2022] DELETE /identity/v3/users/b68a9235ed6843e88aef470868b07d50 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:30.671478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:30.685517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:30.686190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:30.686557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:30.690697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24188d-0bb1-4cfb-a225-e5cb04d1a1e2 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:30.709223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:30.710384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:30.749218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:30.760693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:30.761468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:30.761985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:30.762319 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] PATH_INFO: `/v3/projects/e352f57ae548476fbfd36fcdd470544b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:30.763816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e352f57ae548476fbfd36fcdd470544b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:30.765746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:30.771722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1234/2466] 10.222.0.52 () {58 vars in 967 bytes} [Sun Sep 25 04:37:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:30.786379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:30.787866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:30.835289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:30.839397 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e352f57ae548476fbfd36fcdd470544b', 'request_id': 'req-916501ba-2d09-4808-8092-92c908058146'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.847010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e352f57ae548476fbfd36fcdd470544b', 'request_id': 'req-916501ba-2d09-4808-8092-92c908058146'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.857442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e352f57ae548476fbfd36fcdd470544b', 'request_id': 'req-916501ba-2d09-4808-8092-92c908058146'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.875668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] The token cache is being invalidate because project e352f57ae548476fbfd36fcdd470544b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:30.876032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.876745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-916501ba-2d09-4808-8092-92c908058146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:30.879385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1233/2467] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:30 2022] DELETE /identity/v3/projects/e352f57ae548476fbfd36fcdd470544b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:30.885884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:30.886361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:30.886817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:30.887924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84eff-80f3-4fca-b9ea-c8d9c359eb3c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:30.913382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:30.914736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:30.971877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5dfc-56f2-4e23-ab57-728406bdff1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:30.972672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5dfc-56f2-4e23-ab57-728406bdff1f service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:30.973086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5dfc-56f2-4e23-ab57-728406bdff1f service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:30.973494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5dfc-56f2-4e23-ab57-728406bdff1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:30.975549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-652a5dfc-56f2-4e23-ab57-728406bdff1f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:31.030972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1234/2468] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:31.032948 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.037335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:31.070521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a5dfc-56f2-4e23-ab57-728406bdff1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.070521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a5dfc-56f2-4e23-ab57-728406bdff1f service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.076165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014c0b-adfb-42ea-a112-ff88aeaf91de None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.080771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1235/2469] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:37:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:37:31.085709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e44c-b3f9-4c2d-b730-a2b98b6f1699 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.086724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e44c-b3f9-4c2d-b730-a2b98b6f1699 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.087160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e44c-b3f9-4c2d-b730-a2b98b6f1699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.090442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.092389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.093485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.094866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] PATH_INFO: `/v3/users/3d9172dc313643718a1f093d7b566d75` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.101798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9172dc313643718a1f093d7b566d75)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.106609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.150190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7540e44c-b3f9-4c2d-b730-a2b98b6f1699 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:31.152800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7540e44c-b3f9-4c2d-b730-a2b98b6f1699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:31.173565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1236/2470] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:31.173565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e44c-b3f9-4c2d-b730-a2b98b6f1699 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.186433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e44c-b3f9-4c2d-b730-a2b98b6f1699 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.191858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.192569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.192869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.193148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.194359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:31.194737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.198277 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.211481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9172dc313643718a1f093d7b566d75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:31.212570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9172dc313643718a1f093d7b566d75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:31.233682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1237/2471] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:37:31.239381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.242438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9172dc313643718a1f093d7b566d75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:31.259913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e70b-9f0b-469b-9742-056c18f7a3ed admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.261224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9172dc313643718a1f093d7b566d75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:31.275116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.281807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.282402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.282757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.283439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.285413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.290659 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:31.294192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dac7290f-a5f9-4ce5-bfbb-03c3b8911873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9172dc313643718a1f093d7b566d75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:31.316542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1235/2472] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:31 2022] DELETE /identity/v3/users/3d9172dc313643718a1f093d7b566d75 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:31.327544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.327544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.327544 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.354137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1238/2473] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:31 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:31.355130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.362505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:31.381115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:31.382838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:31.484351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:31.527504 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1236/2474] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:31.534060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.536546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:31.553035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23346f-44f3-4a74-87e5-4a34fb95d49c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.559570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.560321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.560728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.561011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.561651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.565162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.597494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1239/2475] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:31 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:31.601357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.614507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc198df-7fd7-4e42-8c93-ec274b4190f6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.620822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.621555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.621928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.622269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.623121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.624861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.626144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82a42e-2389-4df8-b8cd-4f8bfda2906e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.632389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3324-fb40-4aea-861b-a8ab815be2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.634162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3324-fb40-4aea-861b-a8ab815be2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.634496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3324-fb40-4aea-861b-a8ab815be2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.634778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3324-fb40-4aea-861b-a8ab815be2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.640044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1240/2476] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:31.644631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.656067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5421-496d-490e-a9b3-ca791615db0a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.664687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.665692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.666188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.666698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.667596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.669496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.685270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3324-fb40-4aea-861b-a8ab815be2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.689337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3324-fb40-4aea-861b-a8ab815be2b4 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.690179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1241/2477] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:31.704016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.710164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1237/2478] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:31.731160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ae8b-19c1-4ab8-997b-6ff92bdc8d1e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:31.746999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:31.748610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.749185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.751413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] PATH_INFO: `/v3/projects/8361f772d7b441fc8f6ee8fc58cdf643/users/0842b2d3b45947ef8aa6feb66d069699/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.779200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8361f772d7b441fc8f6ee8fc58cdf643, user_id=0842b2d3b45947ef8aa6feb66d069699, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:31.788650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:31.815667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1242/2479] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:31 2022] PUT /identity/v3/projects/8361f772d7b441fc8f6ee8fc58cdf643/users/0842b2d3b45947ef8aa6feb66d069699/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:31.840987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:31.840987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:31.840987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:31.887360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] MFA Rules not processed for user `0842b2d3b45947ef8aa6feb66d069699`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:31.888615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:31.972993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1238/2480] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:31.994741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:31.996595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:32.059213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:32.060731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:32.121935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61eeb1-8110-4d72-80da-cb6908b05f51 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.127088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3e0da-7921-45e9-ae1c-a3396d98d22d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.127803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:32.128656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3e0da-7921-45e9-ae1c-a3396d98d22d service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.128955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3e0da-7921-45e9-ae1c-a3396d98d22d service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.129319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3e0da-7921-45e9-ae1c-a3396d98d22d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.145291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3e0da-7921-45e9-ae1c-a3396d98d22d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.145291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3e0da-7921-45e9-ae1c-a3396d98d22d service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.153882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1243/2481] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:32.167892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef5d2-c97a-4bfe-8ed9-73d88f655407 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.172509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.173146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.173428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.173708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] PATH_INFO: `/v3/projects/e013633235e24b0a9b64f07ddf35fd7e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.174887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e013633235e24b0a9b64f07ddf35fd7e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.177029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.232918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e013633235e24b0a9b64f07ddf35fd7e', 'request_id': 'req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:32.240911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e013633235e24b0a9b64f07ddf35fd7e', 'request_id': 'req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:32.252484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e013633235e24b0a9b64f07ddf35fd7e', 'request_id': 'req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:32.280987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] The token cache is being invalidate because project e013633235e24b0a9b64f07ddf35fd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:32.280987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:32.280987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e510f1f5-e7e7-4b65-8fec-d0a16a70c84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:32.280987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1239/2482] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:32 2022] DELETE /identity/v3/projects/e013633235e24b0a9b64f07ddf35fd7e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:32.285492 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898046f2-e930-4379-8dde-8ac32e4c4eb5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.285785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898046f2-e930-4379-8dde-8ac32e4c4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.286122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898046f2-e930-4379-8dde-8ac32e4c4eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.309208 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-898046f2-e930-4379-8dde-8ac32e4c4eb5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:32.310715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-898046f2-e930-4379-8dde-8ac32e4c4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:32.380105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1244/2483] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:32.392830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af112-4928-4d9b-be6f-c39259446c15 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.392830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af112-4928-4d9b-be6f-c39259446c15 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.392830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af112-4928-4d9b-be6f-c39259446c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.429390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-806af112-4928-4d9b-be6f-c39259446c15 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:32.429390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-806af112-4928-4d9b-be6f-c39259446c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:32.439882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1240/2484] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:32.445391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898046f2-e930-4379-8dde-8ac32e4c4eb5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:32.462282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898046f2-e930-4379-8dde-8ac32e4c4eb5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.467262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.467945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.468296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.468642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.469957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:32.470273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.471993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.487131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1245/2485] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:32.493510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806af112-4928-4d9b-be6f-c39259446c15 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:32.502568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806af112-4928-4d9b-be6f-c39259446c15 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.523465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.523465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.523465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.523465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.523816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.523816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.570684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1241/2486] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:32 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:32.585950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:32.600619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1da8c-7301-418f-a290-22fa41e67516 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.636473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:32.698934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.699981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.700825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.701407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.702232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.707075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.749582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1246/2487] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:32 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:32.754102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:32.765354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda9a17-74bc-4e80-841b-67eb3e0c3954 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.771222 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.772561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.772561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.772999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.773681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.775534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.788969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1242/2488] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:32.793630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:32.806642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fde924-7c7b-4d41-b1cc-8001458b003a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.811910 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0a6fa-0b2f-47ef-b004-b2d5949755c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.812539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0a6fa-0b2f-47ef-b004-b2d5949755c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.813082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0a6fa-0b2f-47ef-b004-b2d5949755c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.813526 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0a6fa-0b2f-47ef-b004-b2d5949755c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.814287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0a6fa-0b2f-47ef-b004-b2d5949755c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.816411 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0a6fa-0b2f-47ef-b004-b2d5949755c2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.830100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1247/2489] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:32.835122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:32.847539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed42df0-044c-47a3-8b3a-83f6d1ba932b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:32.854739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:32.855480 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.855833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.856185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] PATH_INFO: `/v3/projects/112fd4a0db1144d8bed3083708b026d6/users/ac8a9ff7ce1b48d9b4666c368d5feb2a/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:32.880368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=112fd4a0db1144d8bed3083708b026d6, user_id=ac8a9ff7ce1b48d9b4666c368d5feb2a, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:32.883400 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:32.906117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1243/2490] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:32 2022] PUT /identity/v3/projects/112fd4a0db1144d8bed3083708b026d6/users/ac8a9ff7ce1b48d9b4666c368d5feb2a/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:32.986293 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:32.986865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:32.987339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:33.060883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] MFA Rules not processed for user `ac8a9ff7ce1b48d9b4666c368d5feb2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:33.063722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:33.194245 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1248/2491] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:33.249021 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:33.255651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:33.316958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b36f-7af6-41db-9b33-73ae1066ccdd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:33.320818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:33.321396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:33.321703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:33.322243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:33.330706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:33.332448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:33.336232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:33.343855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1244/2492] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:34.284913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:34.286435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:34.347514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:34.357754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3fbcd-62a2-4195-8ccb-d48545795261 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:34.362698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ec83-1d22-4430-a6ca-2fd4966dae0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:34.363329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ec83-1d22-4430-a6ca-2fd4966dae0f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:34.363772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ec83-1d22-4430-a6ca-2fd4966dae0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:34.364110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ec83-1d22-4430-a6ca-2fd4966dae0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:34.365899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e0a5ec83-1d22-4430-a6ca-2fd4966dae0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:34.424918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ef40-3ee7-4ca9-91c5-e4b80286a25a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:34.431028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:34.431678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:34.432076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:34.432382 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] PATH_INFO: `/v3/users/39baed89cf14467cbebb87523a17c8ec` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:34.433863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39baed89cf14467cbebb87523a17c8ec)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:34.436866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:34.463891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ec83-1d22-4430-a6ca-2fd4966dae0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:34.465542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ec83-1d22-4430-a6ca-2fd4966dae0f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:34.467241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:34.477308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1245/2493] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:34.501676 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39baed89cf14467cbebb87523a17c8ec'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:34.513402 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39baed89cf14467cbebb87523a17c8ec'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:34.514130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39baed89cf14467cbebb87523a17c8ec'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:34.514846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39baed89cf14467cbebb87523a17c8ec'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:34.524338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39baed89cf14467cbebb87523a17c8ec'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:34.546273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1249/2494] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:34 2022] DELETE /identity/v3/users/39baed89cf14467cbebb87523a17c8ec => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:34.551487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:34.551873 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:34.552046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:34.574398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:34.575829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:34.662479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1246/2495] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:34.673531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:34.675771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:34.752605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b4ee2-3120-4654-90d3-54571f92f25c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:34.764860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc590760-0bce-4cbc-8faf-45e9154345f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:34.765580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc590760-0bce-4cbc-8faf-45e9154345f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:34.766644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc590760-0bce-4cbc-8faf-45e9154345f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:34.766940 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc590760-0bce-4cbc-8faf-45e9154345f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:34.789869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc590760-0bce-4cbc-8faf-45e9154345f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:34.792117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc590760-0bce-4cbc-8faf-45e9154345f4 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:34.805811 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1250/2496] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:35.089947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:35.092333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:35.116695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd7db-ee19-430e-ad2d-3621e2ba0008 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:35.126760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:35.127407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:35.127728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:35.128063 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] PATH_INFO: `/v3/projects/4b37f7624d1b4fd69cd6402e5430a766` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:35.134107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b37f7624d1b4fd69cd6402e5430a766)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:35.138570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:35.214904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b37f7624d1b4fd69cd6402e5430a766', 'request_id': 'req-9892c650-74ef-48d3-a0b9-db40a5e4933b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:35.227448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b37f7624d1b4fd69cd6402e5430a766', 'request_id': 'req-9892c650-74ef-48d3-a0b9-db40a5e4933b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:35.237121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b37f7624d1b4fd69cd6402e5430a766', 'request_id': 'req-9892c650-74ef-48d3-a0b9-db40a5e4933b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:35.252780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] The token cache is being invalidate because project 4b37f7624d1b4fd69cd6402e5430a766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:35.253327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:35.271020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:35.273197 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1247/2497] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:35 2022] DELETE /identity/v3/projects/4b37f7624d1b4fd69cd6402e5430a766 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:35.808643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51747bee-6e47-476c-b4fa-3570b66c9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:35.809258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51747bee-6e47-476c-b4fa-3570b66c9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:35.809426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51747bee-6e47-476c-b4fa-3570b66c9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:35.832250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-51747bee-6e47-476c-b4fa-3570b66c9fa2 None None] MFA Rules not processed for user `5bdeb69b2259462b90c34aede652f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:35.833504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-51747bee-6e47-476c-b4fa-3570b66c9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:35.889877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1251/2498] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:36.643347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:36.643347 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:36.674630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:36.758761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892c650-74ef-48d3-a0b9-db40a5e4933b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:36.770551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:36.771416 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:36.771785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:36.772099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] PATH_INFO: `/v3/users/9f616231be374dcc8b3a2cdcf6af08a5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:36.773399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f616231be374dcc8b3a2cdcf6af08a5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:36.775848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:36.836538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f616231be374dcc8b3a2cdcf6af08a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:36.837278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f616231be374dcc8b3a2cdcf6af08a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:36.847045 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f616231be374dcc8b3a2cdcf6af08a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:36.854525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f616231be374dcc8b3a2cdcf6af08a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:36.868018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f616231be374dcc8b3a2cdcf6af08a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:36.874230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1248/2499] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:36 2022] DELETE /identity/v3/users/9f616231be374dcc8b3a2cdcf6af08a5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:36.878932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6170-e252-4555-a664-4b29418117cf None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:36.880117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6170-e252-4555-a664-4b29418117cf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:36.880398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6170-e252-4555-a664-4b29418117cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:36.901352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c16a6170-e252-4555-a664-4b29418117cf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:36.902591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c16a6170-e252-4555-a664-4b29418117cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:36.960751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:36.979804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1252/2500] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:36.991389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:36.993501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:37.059264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa747c05-7774-4b71-b7fd-11de2361571d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.064147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769df1ae-8b73-47a6-b66b-c9dc882685ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.065600 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df1ae-8b73-47a6-b66b-c9dc882685ce service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.065876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df1ae-8b73-47a6-b66b-c9dc882685ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.066219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df1ae-8b73-47a6-b66b-c9dc882685ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.077603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769df1ae-8b73-47a6-b66b-c9dc882685ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:37.079210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769df1ae-8b73-47a6-b66b-c9dc882685ce service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:37.088915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1249/2501] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:37.400098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6170-e252-4555-a664-4b29418117cf None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:37.405545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c16a6170-e252-4555-a664-4b29418117cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:37.425982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6170-e252-4555-a664-4b29418117cf None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.435451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.436137 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.436418 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.436722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] PATH_INFO: `/v3/projects/cd6ddb036f184e3da7c7d398fa8cc84b` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.438041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6ddb036f184e3da7c7d398fa8cc84b)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:37.440638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:37.492542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6ddb036f184e3da7c7d398fa8cc84b', 'request_id': 'req-d24259e0-73fa-4b07-967a-ac02ac8427dd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:37.498689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6ddb036f184e3da7c7d398fa8cc84b', 'request_id': 'req-d24259e0-73fa-4b07-967a-ac02ac8427dd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:37.506559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6ddb036f184e3da7c7d398fa8cc84b', 'request_id': 'req-d24259e0-73fa-4b07-967a-ac02ac8427dd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:37.518852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] The token cache is being invalidate because project cd6ddb036f184e3da7c7d398fa8cc84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:37.519151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:37.519820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d24259e0-73fa-4b07-967a-ac02ac8427dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:37.521370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1253/2502] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:37 2022] DELETE /identity/v3/projects/cd6ddb036f184e3da7c7d398fa8cc84b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:37.527359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2b509-c226-4550-99d1-e04aac827e7b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.527648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2b509-c226-4550-99d1-e04aac827e7b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.527925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2b509-c226-4550-99d1-e04aac827e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.548893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e6c2b509-c226-4550-99d1-e04aac827e7b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:37.550107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e6c2b509-c226-4550-99d1-e04aac827e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:37.586564 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:37.615296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1250/2503] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:37.623225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b540e-44f2-43dd-a0ea-118be78102dc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.623542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b540e-44f2-43dd-a0ea-118be78102dc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.623823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b540e-44f2-43dd-a0ea-118be78102dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.646669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-220b540e-44f2-43dd-a0ea-118be78102dc None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:37.648103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-220b540e-44f2-43dd-a0ea-118be78102dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:37.657225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1254/2504] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:37.661752 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2b509-c226-4550-99d1-e04aac827e7b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:37.671466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2b509-c226-4550-99d1-e04aac827e7b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.676210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.676816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.677094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.677366 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.678004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:37.678303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:37.679925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:37.698702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1251/2505] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:37.700703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b540e-44f2-43dd-a0ea-118be78102dc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:37.710604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b540e-44f2-43dd-a0ea-118be78102dc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.715358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.715966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.716248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.716528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.717159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:37.719223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:37.748936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1255/2506] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:37 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:37.751703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:37.764863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a8c3f-18a3-47f0-968e-1a0504d0efb4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.832019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.832825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.833200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.833603 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.834533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:37.836776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:37.862228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1252/2507] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:37 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:37.866437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:37.886457 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b42ae-4b95-46e3-86fb-c56f2c93d04e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.891075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.892135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.892773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.893226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.894073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:37.896098 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:37.908172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1256/2508] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:37.912524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:37.925908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3d80-5fd1-48b9-942f-5bcf89183235 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.934128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16108a15-4692-4310-8ee7-ecae91e46fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.934872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108a15-4692-4310-8ee7-ecae91e46fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.935221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108a15-4692-4310-8ee7-ecae91e46fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.935577 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108a15-4692-4310-8ee7-ecae91e46fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:37.937114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16108a15-4692-4310-8ee7-ecae91e46fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:37.938954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16108a15-4692-4310-8ee7-ecae91e46fdc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:37.958059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1253/2509] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:37.959588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:37.972009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e8385-c0af-4bb9-8af3-a2d56c41e32b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:37.983075 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:37.986962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:37.987454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:37.987920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] PATH_INFO: `/v3/projects/dfe5e2a7cc8c4ac4bab1dab633f404e3/users/7c93b01a803d467f9b6a9d90962c3ffd/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:38.009848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe5e2a7cc8c4ac4bab1dab633f404e3, user_id=7c93b01a803d467f9b6a9d90962c3ffd, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:38.012881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:38.037742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1257/2510] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:37 2022] PUT /identity/v3/projects/dfe5e2a7cc8c4ac4bab1dab633f404e3/users/7c93b01a803d467f9b6a9d90962c3ffd/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:38.043005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:38.043299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:38.043578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:38.064131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:38.067085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:38.149249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1254/2511] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:38.159287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:38.161052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:38.227271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee51d8e-de07-4bee-b315-3798a78c00ff admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:38.247171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca491-2d3a-45bd-9128-9e77c404140f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:38.247171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca491-2d3a-45bd-9128-9e77c404140f service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:38.247171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca491-2d3a-45bd-9128-9e77c404140f service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:38.247171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca491-2d3a-45bd-9128-9e77c404140f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:38.247710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca491-2d3a-45bd-9128-9e77c404140f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:38.249391 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca491-2d3a-45bd-9128-9e77c404140f service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:38.265656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1258/2512] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:39.632091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:39.633689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:39.651350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744eaf7-d019-4637-8e17-f374e137f934 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:39.666802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:39.666802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:39.666802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:39.666802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] PATH_INFO: `/v3/users/5c6f177a61414bfa8b31e278f2315c6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:39.667196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6f177a61414bfa8b31e278f2315c6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:39.667196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:39.740255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:39.756334 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6f177a61414bfa8b31e278f2315c6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:39.757340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6f177a61414bfa8b31e278f2315c6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:39.780827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6f177a61414bfa8b31e278f2315c6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:39.792293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6f177a61414bfa8b31e278f2315c6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:39.813829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6f177a61414bfa8b31e278f2315c6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:39.822618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1255/2513] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:39 2022] DELETE /identity/v3/users/5c6f177a61414bfa8b31e278f2315c6d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:39.827399 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:39.827921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:39.828025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:39.866755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:39.873541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:39.887819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:40.082441 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1259/2514] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:40.116992 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:40.118377 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:40.242491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dce18-e01e-4766-abd6-e12ffd341996 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:40.246612 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:40.247233 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:40.250734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:40.253903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:40.281782 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:40.284583 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:40.297723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1256/2515] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:41.130948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:41.133008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:41.156353 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965685-b766-40a2-be14-c11e47a79e5d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:41.171151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:41.172813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:41.173106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:41.173386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] PATH_INFO: `/v3/projects/9a59f5554f3b4ae1a9e5a489211bee88` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:41.176116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a59f5554f3b4ae1a9e5a489211bee88)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:41.179569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:41.271186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a59f5554f3b4ae1a9e5a489211bee88', 'request_id': 'req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.306898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a59f5554f3b4ae1a9e5a489211bee88', 'request_id': 'req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.318319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a59f5554f3b4ae1a9e5a489211bee88', 'request_id': 'req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.337930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] The token cache is being invalidate because project 9a59f5554f3b4ae1a9e5a489211bee88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:41.338233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.339224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.342191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1260/2516] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:41 2022] DELETE /identity/v3/projects/9a59f5554f3b4ae1a9e5a489211bee88 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:41.346472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:41.358850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55586c3-b61b-4f66-9353-241779a5a75c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:41.472479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:41.474847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:41.474847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:41.474847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] PATH_INFO: `/v3/users/2cdf65130e7349b380907d5c2e0d40a3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:41.475887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdf65130e7349b380907d5c2e0d40a3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:41.480351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:41.589795 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdf65130e7349b380907d5c2e0d40a3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.593419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdf65130e7349b380907d5c2e0d40a3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.622256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdf65130e7349b380907d5c2e0d40a3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.647853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:41.654548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdf65130e7349b380907d5c2e0d40a3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.680034 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c2bd3910-69a2-4395-983f-f4622c5cc9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdf65130e7349b380907d5c2e0d40a3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:41.690313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1257/2517] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:41 2022] DELETE /identity/v3/users/2cdf65130e7349b380907d5c2e0d40a3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:42.271294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:42.273774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:42.300891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f3339-bc87-4244-9ca9-07abf2cbb7c9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:42.382131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:42.382941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:42.383462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:42.384160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] PATH_INFO: `/v3/projects/2bcddfdada31429f96e21e2372bd7ae9` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:42.385121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bcddfdada31429f96e21e2372bd7ae9)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:42.387190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:42.443538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:42.460798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bcddfdada31429f96e21e2372bd7ae9', 'request_id': 'req-b2400fbb-5476-4186-8049-3083806e5412'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:42.473463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bcddfdada31429f96e21e2372bd7ae9', 'request_id': 'req-b2400fbb-5476-4186-8049-3083806e5412'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:42.486180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bcddfdada31429f96e21e2372bd7ae9', 'request_id': 'req-b2400fbb-5476-4186-8049-3083806e5412'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:42.514326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] The token cache is being invalidate because project 2bcddfdada31429f96e21e2372bd7ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:42.516005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:42.518578 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2400fbb-5476-4186-8049-3083806e5412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:42.522782 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1261/2518] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:42 2022] DELETE /identity/v3/projects/2bcddfdada31429f96e21e2372bd7ae9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:42.528637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b8412-5870-4402-aaa3-2e535f913761 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:42.529142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b8412-5870-4402-aaa3-2e535f913761 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:42.529239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b8412-5870-4402-aaa3-2e535f913761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:42.566331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8f6b8412-5870-4402-aaa3-2e535f913761 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:42.568121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8f6b8412-5870-4402-aaa3-2e535f913761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:42.675771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1258/2519] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:42.683827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ebbdf-bf9f-4466-8ac4-6fef2e536a93 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:42.684121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ebbdf-bf9f-4466-8ac4-6fef2e536a93 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:42.684401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ebbdf-bf9f-4466-8ac4-6fef2e536a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:42.716180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e10ebbdf-bf9f-4466-8ac4-6fef2e536a93 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:42.716859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e10ebbdf-bf9f-4466-8ac4-6fef2e536a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:42.736151 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1262/2520] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:42.741220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b8412-5870-4402-aaa3-2e535f913761 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:42.760800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b8412-5870-4402-aaa3-2e535f913761 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:42.768912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:42.769550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:42.769835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:42.770614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:42.771286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:42.771890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:42.773834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:42.788177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1259/2521] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:42.792484 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ebbdf-bf9f-4466-8ac4-6fef2e536a93 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:42.802037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ebbdf-bf9f-4466-8ac4-6fef2e536a93 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:42.807224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:42.807836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:42.808120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:42.808397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:42.809055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:42.811007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:42.850942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1263/2522] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:42 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:42.854722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:42.865849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6e1c-dca5-4c69-b5f5-021fbb824664 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:42.936957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:42.938125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:42.938646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:42.938920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:42.939554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:42.943503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:42.967373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1260/2523] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:42 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:42.971305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:42.983949 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799bd8b-51fd-4c20-9d1b-f3f7b25756a0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:42.990407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:42.991102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:42.991517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:42.991790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:42.992453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:42.994056 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:43.010788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1264/2524] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:43.012487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:43.024153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca82c2-6a39-49dd-9840-bbf4e25c21ba admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:43.029535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8aa9b-9132-46fd-8809-444c421b8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:43.029690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8aa9b-9132-46fd-8809-444c421b8320 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:43.030046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8aa9b-9132-46fd-8809-444c421b8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:43.030330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8aa9b-9132-46fd-8809-444c421b8320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:43.031351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8aa9b-9132-46fd-8809-444c421b8320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:43.032837 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8aa9b-9132-46fd-8809-444c421b8320 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:43.045584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1261/2525] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:43.050482 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:43.064490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a305c3-cc2b-4de7-879a-015d8651eb98 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:43.069803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:43.070123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:43.070551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:43.070918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] PATH_INFO: `/v3/projects/416370ea758842bd979dda1f292f96ab/users/50bcd3669eda426ba6156cb668a9a075/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:43.090911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=416370ea758842bd979dda1f292f96ab, user_id=50bcd3669eda426ba6156cb668a9a075, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:43.093938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:43.114513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1265/2526] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:43 2022] PUT /identity/v3/projects/416370ea758842bd979dda1f292f96ab/users/50bcd3669eda426ba6156cb668a9a075/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:43.131628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b692-e2ea-4a71-93fd-2ff988e05f9c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:43.131628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b692-e2ea-4a71-93fd-2ff988e05f9c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:43.131628 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b692-e2ea-4a71-93fd-2ff988e05f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:43.176081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-faf3b692-e2ea-4a71-93fd-2ff988e05f9c None None] MFA Rules not processed for user `50bcd3669eda426ba6156cb668a9a075`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:43.177763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-faf3b692-e2ea-4a71-93fd-2ff988e05f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:43.219679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:43.271285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1262/2527] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:43.288456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:43.290834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:43.372544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4240a-0f1e-4a1b-bd7e-fb508ad44d4a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:43.380210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:43.380948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:43.381310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:43.381778 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:43.393384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:43.394691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:43.409109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1266/2528] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:44.787608 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:44.788140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:44.789354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:44.830727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] MFA Rules not processed for user `7c93b01a803d467f9b6a9d90962c3ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:44.831962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:44.911130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1263/2529] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:44.916011 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:44.917893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:44.993780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:44.999476 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:45.030138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404998be-5c08-434d-94a6-d10ea31209eb service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.038807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.039828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.040285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.040699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.041516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.043981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.057384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:45.083585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1267/2530] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:44 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:45.087631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:45.120484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c175bda-9899-4673-9c59-e6e58a9c33db None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.168034 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb8e2-8b34-44c6-9216-77cfcd6b9b75 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.176088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.176759 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.177044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.177318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.177966 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.180022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.210523 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1268/2531] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:45 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:45.212427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.213543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.213809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.214090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] PATH_INFO: `/v3/users/ac8a9ff7ce1b48d9b4666c368d5feb2a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.214703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:45.215371 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8a9ff7ce1b48d9b4666c368d5feb2a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.217376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.236144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa954-2cf0-4c9a-8715-ef765f5b3b6c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.241708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:45.242301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.243550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.243941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.244317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.245097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.247712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.261981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1269/2532] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:45.265932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:45.277175 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eca01-620d-4c1c-ad84-0d9bf13f28ca admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.283592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.284374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.284756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.285131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] PATH_INFO: `/v3/projects/41245bd4884e4961b1771defa30832e6/users/1aae412bf7ec4c39b728d9a37198d9fa/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.293128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8a9ff7ce1b48d9b4666c368d5feb2a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:45.294470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8a9ff7ce1b48d9b4666c368d5feb2a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:45.302045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41245bd4884e4961b1771defa30832e6, user_id=1aae412bf7ec4c39b728d9a37198d9fa, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.304764 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.305270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8a9ff7ce1b48d9b4666c368d5feb2a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:45.316757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8a9ff7ce1b48d9b4666c368d5feb2a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:45.320510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1270/2533] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:45 2022] PUT /identity/v3/projects/41245bd4884e4961b1771defa30832e6/users/1aae412bf7ec4c39b728d9a37198d9fa/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:45.326003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:45.338962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a234f403-777e-4130-9518-59edcd3a1161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8a9ff7ce1b48d9b4666c368d5feb2a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:45.350572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1264/2534] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:44 2022] DELETE /identity/v3/users/ac8a9ff7ce1b48d9b4666c368d5feb2a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:45.352302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.352611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.352861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.392629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:45.393029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:45.409673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d3fa-d2d2-4e05-96ab-c81d30c57f87 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.476812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1265/2535] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:45.488126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:45.489695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:45.529197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:45.548865 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.549808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.550539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.550968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.552100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.554070 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.570097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1271/2536] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:37:45.574722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:45.582642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:45.599316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed92a09-2ca5-49af-8396-9c80498d19d8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.604200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f3f6-0697-493f-8e3b-9fca9945bcf5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:45.608757 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.609702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.610129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.613561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:45.614294 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:45.615323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:45.615720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.616481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] PATH_INFO: `/v3/projects/41245bd4884e4961b1771defa30832e6/users/1aae412bf7ec4c39b728d9a37198d9fa/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:45.620029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41245bd4884e4961b1771defa30832e6, user_id=1aae412bf7ec4c39b728d9a37198d9fa, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.623945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.628910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:45.630721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:45.647751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1266/2538] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:37:45.654435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1272/2538] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:45 2022] PUT /identity/v3/projects/41245bd4884e4961b1771defa30832e6/users/1aae412bf7ec4c39b728d9a37198d9fa/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:46.112729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:46.114513 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:46.136084 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f819-72a8-4f4c-ac6b-565a4d457531 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:46.180478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:46.225767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:46.228894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:46.229370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:46.229790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] PATH_INFO: `/v3/projects/112fd4a0db1144d8bed3083708b026d6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:46.235640 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112fd4a0db1144d8bed3083708b026d6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:46.237632 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:46.264213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:46.266683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:46.289168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323f380-a8b8-44a9-af8a-5afded9cdb2b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:46.295426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:46.297224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:46.298089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:46.298551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] PATH_INFO: `/v3/users/50bcd3669eda426ba6156cb668a9a075` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:46.300226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bcd3669eda426ba6156cb668a9a075)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:46.307279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:46.331975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112fd4a0db1144d8bed3083708b026d6', 'request_id': 'req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.342639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112fd4a0db1144d8bed3083708b026d6', 'request_id': 'req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.357572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112fd4a0db1144d8bed3083708b026d6', 'request_id': 'req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.385438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] The token cache is being invalidate because project 112fd4a0db1144d8bed3083708b026d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:46.385933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.387309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4030a8d8-ea6a-4357-9f0b-5fe69c3b6d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.389667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bcd3669eda426ba6156cb668a9a075'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.408147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1267/2539] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:46 2022] DELETE /identity/v3/projects/112fd4a0db1144d8bed3083708b026d6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:46.423936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bcd3669eda426ba6156cb668a9a075'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.424945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bcd3669eda426ba6156cb668a9a075'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.425809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bcd3669eda426ba6156cb668a9a075'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.454180 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bcd3669eda426ba6156cb668a9a075'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:46.500977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1273/2540] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:46 2022] DELETE /identity/v3/users/50bcd3669eda426ba6156cb668a9a075 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:46.505706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:46.506244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:46.506563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:46.560613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:46.562519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:46.650276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1268/2541] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:46.660496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:46.662258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:46.818281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f5ce-f605-42d3-bdf9-34277c463582 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:46.822334 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c917e-3333-4671-ac50-d9eceb39e000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:46.822983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c917e-3333-4671-ac50-d9eceb39e000 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:46.823347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c917e-3333-4671-ac50-d9eceb39e000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:46.823518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c917e-3333-4671-ac50-d9eceb39e000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:46.850528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c917e-3333-4671-ac50-d9eceb39e000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:46.851996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c917e-3333-4671-ac50-d9eceb39e000 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:46.863894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1274/2542] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:47.696670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:47.699105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:47.714898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78769c59-be3e-4416-9cd2-479a42c77ed2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:47.722750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:47.724438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:47.725171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:47.726588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] PATH_INFO: `/v3/projects/416370ea758842bd979dda1f292f96ab` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:47.730228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=416370ea758842bd979dda1f292f96ab)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:47.734947 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:47.808940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416370ea758842bd979dda1f292f96ab', 'request_id': 'req-8433f955-9f25-41da-b16f-1b88189f9f84'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:47.818541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416370ea758842bd979dda1f292f96ab', 'request_id': 'req-8433f955-9f25-41da-b16f-1b88189f9f84'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:47.825341 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:47.836861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416370ea758842bd979dda1f292f96ab', 'request_id': 'req-8433f955-9f25-41da-b16f-1b88189f9f84'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:47.862220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] The token cache is being invalidate because project 416370ea758842bd979dda1f292f96ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:37:47.862556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:47.863217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8433f955-9f25-41da-b16f-1b88189f9f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:37:47.865176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1269/2543] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:37:47 2022] DELETE /identity/v3/projects/416370ea758842bd979dda1f292f96ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:37:47.870010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa4790-c4e2-4601-a3b4-37973646eed2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:47.870529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa4790-c4e2-4601-a3b4-37973646eed2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:47.870737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa4790-c4e2-4601-a3b4-37973646eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:47.907998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4bfa4790-c4e2-4601-a3b4-37973646eed2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:47.911212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4bfa4790-c4e2-4601-a3b4-37973646eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:48.013140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:48.038259 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1275/2544] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:48.046630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3c49-8218-40c4-b835-1a0b07c81ee2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.046927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3c49-8218-40c4-b835-1a0b07c81ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.047232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3c49-8218-40c4-b835-1a0b07c81ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.070437 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-886a3c49-8218-40c4-b835-1a0b07c81ee2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:48.072412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-886a3c49-8218-40c4-b835-1a0b07c81ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:48.084542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1270/2545] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:37:48.085727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa4790-c4e2-4601-a3b4-37973646eed2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:48.113963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa4790-c4e2-4601-a3b4-37973646eed2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:48.134970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:48.135528 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.135813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.136149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.136836 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:37:48.137668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:48.144281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:48.194039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3c49-8218-40c4-b835-1a0b07c81ee2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:48.195509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1276/2546] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:37:48.208024 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3c49-8218-40c4-b835-1a0b07c81ee2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:48.220372 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:48.221134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.221534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.221901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.222721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:48.224806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:48.276012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1271/2547] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:37:48 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:37:48.282213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:48.302080 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e742-f197-4ed6-9ced-625ee32dac8c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:48.469866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:48.470535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.470819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.471099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.472585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:48.478284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:48.536269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1277/2548] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:37:48 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:37:48.540073 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:48.556559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d285-011e-44df-8422-367fef877fa1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:48.573230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:48.576648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.583314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.585569 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.586901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:48.601460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:48.628182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1272/2549] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:48.631839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:48.649524 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca646d47-5dc5-4857-9eb4-9168b13fcb02 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:48.657120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3451f-7c8a-4669-acf7-f64e9b24a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:48.658039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3451f-7c8a-4669-acf7-f64e9b24a4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.658538 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3451f-7c8a-4669-acf7-f64e9b24a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.658967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3451f-7c8a-4669-acf7-f64e9b24a4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.659806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3451f-7c8a-4669-acf7-f64e9b24a4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:48.661858 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3451f-7c8a-4669-acf7-f64e9b24a4f7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:48.680617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1278/2550] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:37:48.685351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:48.706092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75d58d-3f38-46f1-8528-609ebcfda6ed admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:48.715183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:48.716418 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.716930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.717420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] PATH_INFO: `/v3/projects/a9a1df0a1db54645aeb56a987a57e658/users/8f9c04c24aea453fb3957fbaa4475b18/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.739351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a1df0a1db54645aeb56a987a57e658, user_id=8f9c04c24aea453fb3957fbaa4475b18, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:48.743083 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:48.759049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1273/2551] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:37:48 2022] PUT /identity/v3/projects/a9a1df0a1db54645aeb56a987a57e658/users/8f9c04c24aea453fb3957fbaa4475b18/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:37:48.764116 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf803e9-74e6-46c6-8c10-54eafaaec517 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:48.764749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf803e9-74e6-46c6-8c10-54eafaaec517 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:48.765138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf803e9-74e6-46c6-8c10-54eafaaec517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:48.790388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ddf803e9-74e6-46c6-8c10-54eafaaec517 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:48.791777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ddf803e9-74e6-46c6-8c10-54eafaaec517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:48.890213 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1279/2552] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:48.897597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:48.899591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:48.992690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c6d3c-ff1f-4b4c-b6ee-74ef396173fe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:48.999006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:48.999780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:49.000743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:49.001789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:49.017663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:49.019188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:49.031996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1274/2553] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:51.063364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c8374-0c96-44c0-b9f6-34d5f66e0b4b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:51.064184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c8374-0c96-44c0-b9f6-34d5f66e0b4b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:51.064615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c8374-0c96-44c0-b9f6-34d5f66e0b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:51.132907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-651c8374-0c96-44c0-b9f6-34d5f66e0b4b None None] MFA Rules not processed for user `8f9c04c24aea453fb3957fbaa4475b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:51.134511 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-651c8374-0c96-44c0-b9f6-34d5f66e0b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:51.227152 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:51.278792 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1280/2554] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:51.288862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:51.293830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:51.470930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02629bf0-27ec-4ef6-bcb7-6a3105cd4db0 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:51.484888 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:51.485741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:51.486033 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:51.487049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:51.506445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:51.507940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:51.531597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1275/2555] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:52.293133 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e722de1-da70-440e-87be-2179ed206cec None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:52.294122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e722de1-da70-440e-87be-2179ed206cec None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:52.294650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e722de1-da70-440e-87be-2179ed206cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:52.357379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0e722de1-da70-440e-87be-2179ed206cec None None] MFA Rules not processed for user `1aae412bf7ec4c39b728d9a37198d9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:52.359613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0e722de1-da70-440e-87be-2179ed206cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:52.495267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1281/2556] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:52.510077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:52.512140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:52.551872 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:52.584496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1efd-23fc-40cb-984c-4d5b06c3b87c service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:52.588321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:52.589019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:52.589361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:52.589702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:52.592203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:52.727576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:52.731081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:52.746766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1276/2557] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:37:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:37:52.907297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc748cb-4d6b-445d-9f50-f0b87855c96b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:52.907592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc748cb-4d6b-445d-9f50-f0b87855c96b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:52.907880 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc748cb-4d6b-445d-9f50-f0b87855c96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:52.928844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4fc748cb-4d6b-445d-9f50-f0b87855c96b None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:52.930283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4fc748cb-4d6b-445d-9f50-f0b87855c96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:52.997480 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1282/2558] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:37:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:53.011436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:53.012950 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:53.093284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45550-9984-4fe3-acd7-704ed8dc2e46 service glance] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:53.099562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:53.100053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:53.100223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:53.100541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:53.112142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:53.113812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:37:53.127767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1277/2559] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:37:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:37:53.246791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753db54-be63-4cbb-bbe2-131baa5bfed4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:53.247464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753db54-be63-4cbb-bbe2-131baa5bfed4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:53.248032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753db54-be63-4cbb-bbe2-131baa5bfed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:53.295432 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8753db54-be63-4cbb-bbe2-131baa5bfed4 None None] MFA Rules not processed for user `8f9c04c24aea453fb3957fbaa4475b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:37:53.298907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8753db54-be63-4cbb-bbe2-131baa5bfed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:53.316062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1283/2560] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:37:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:37:59.832430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:37:59.835351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:37:59.853432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ab21-c630-4205-80b5-74ebacccab88 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:37:59.859668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:37:59.860686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:37:59.861344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:37:59.861847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] PATH_INFO: `/v3/users/0842b2d3b45947ef8aa6feb66d069699` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:37:59.863388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0842b2d3b45947ef8aa6feb66d069699)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:37:59.866091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:00.047744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0842b2d3b45947ef8aa6feb66d069699'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.048451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0842b2d3b45947ef8aa6feb66d069699'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.064882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0842b2d3b45947ef8aa6feb66d069699'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.077741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0842b2d3b45947ef8aa6feb66d069699'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.084689 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:00.096335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0842b2d3b45947ef8aa6feb66d069699'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.105680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1278/2561] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:37:59 2022] DELETE /identity/v3/users/0842b2d3b45947ef8aa6feb66d069699 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:38:00.111099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:00.112128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:00.112620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:00.137972 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:00.139248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:00.217832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1284/2562] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:00.229462 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:00.231185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:00.341495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16747d34-7154-4232-add7-c784064d7069 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:00.348607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fc4ff-73cd-49cf-b8d7-c31afc33da62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:00.349324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fc4ff-73cd-49cf-b8d7-c31afc33da62 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:00.349601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fc4ff-73cd-49cf-b8d7-c31afc33da62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:00.351039 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fc4ff-73cd-49cf-b8d7-c31afc33da62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:00.369662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fc4ff-73cd-49cf-b8d7-c31afc33da62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:00.371149 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fc4ff-73cd-49cf-b8d7-c31afc33da62 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:00.382203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1279/2563] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:00.696584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:00.698743 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:00.722182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3ec89-5766-45e4-8e3f-547d08a76906 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:00.726923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:00.727600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:00.727879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:00.728227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] PATH_INFO: `/v3/projects/8361f772d7b441fc8f6ee8fc58cdf643` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:00.729477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8361f772d7b441fc8f6ee8fc58cdf643)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:00.731387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:00.735350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:00.792052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8361f772d7b441fc8f6ee8fc58cdf643', 'request_id': 'req-199b5124-468b-4aec-a28d-7295540d96c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.800349 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8361f772d7b441fc8f6ee8fc58cdf643', 'request_id': 'req-199b5124-468b-4aec-a28d-7295540d96c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.810531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8361f772d7b441fc8f6ee8fc58cdf643', 'request_id': 'req-199b5124-468b-4aec-a28d-7295540d96c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.821613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] The token cache is being invalidate because project 8361f772d7b441fc8f6ee8fc58cdf643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:38:00.821903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.822907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-199b5124-468b-4aec-a28d-7295540d96c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:38:00.824683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1285/2564] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:38:00 2022] DELETE /identity/v3/projects/8361f772d7b441fc8f6ee8fc58cdf643 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:38:03.763623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:03.764620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:03.764960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:03.789799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] MFA Rules not processed for user `7c93b01a803d467f9b6a9d90962c3ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:03.791146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:03.849805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1280/2565] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:38:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:06.491501 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd974d6-58d5-4aa1-b0d7-21ecb94598b2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:06.492042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd974d6-58d5-4aa1-b0d7-21ecb94598b2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:06.492252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd974d6-58d5-4aa1-b0d7-21ecb94598b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:06.513587 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dcd974d6-58d5-4aa1-b0d7-21ecb94598b2 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:06.515356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dcd974d6-58d5-4aa1-b0d7-21ecb94598b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:06.582473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1286/2566] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:06.595645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:06.597634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:06.693555 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bb15a-d28f-4d80-9d98-094279e2ae91 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:06.705721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:06.706550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:06.706935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:06.707314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:06.720677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:06.722765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:06.759629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1281/2567] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:38:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:38:16.574565 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:16.728818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=2,keystone:SELECT=88 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:25.189280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817fde0-f528-41ff-8a1f-58683f9f9903 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:25.189830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817fde0-f528-41ff-8a1f-58683f9f9903 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:25.189830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817fde0-f528-41ff-8a1f-58683f9f9903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:25.209957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6817fde0-f528-41ff-8a1f-58683f9f9903 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:25.211201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6817fde0-f528-41ff-8a1f-58683f9f9903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:25.269727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1287/2568] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:25.285337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:25.286834 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:25.359615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf415e-2fe1-4af8-8f24-f4e8d51f76d7 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:25.364940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:25.365566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:25.365848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:25.366123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:25.374401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:25.375983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:25.385346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1282/2569] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:28.317644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da4995-27ff-4b3d-bab9-2becb81bdf59 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:28.318183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da4995-27ff-4b3d-bab9-2becb81bdf59 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:28.318302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da4995-27ff-4b3d-bab9-2becb81bdf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:28.338600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f7da4995-27ff-4b3d-bab9-2becb81bdf59 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:28.340076 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f7da4995-27ff-4b3d-bab9-2becb81bdf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:28.352071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1288/2570] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:28.368829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:28.370316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:28.385686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfb049-bbc6-47c2-abde-7fa62d5aa912 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:28.391890 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:28.392494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:28.392774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:28.393049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:28.401680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:28.403281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:28.413092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1283/2571] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:31.481389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:31.481890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:31.481890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:31.502470 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:31.503688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:31.511692 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1289/2572] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:31.528472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:31.540198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d761bae-e7c6-424c-a6c3-a7b722459ec4 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:31.546378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374a02a-01d1-458c-a7c3-fd99bdccef2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:31.546997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374a02a-01d1-458c-a7c3-fd99bdccef2d service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:31.547278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374a02a-01d1-458c-a7c3-fd99bdccef2d service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:31.547548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374a02a-01d1-458c-a7c3-fd99bdccef2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:31.555587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374a02a-01d1-458c-a7c3-fd99bdccef2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:31.557165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374a02a-01d1-458c-a7c3-fd99bdccef2d service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:31.566822 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1284/2573] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:32.574292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:32.575826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:32.632679 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fe762-935b-4879-baee-c416f341c302 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:32.636278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:32.636882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:32.637162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:32.637435 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:32.639187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:32.703351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:32.704963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:32.718007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1290/2574] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:34.581512 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821775-2597-4014-bcf0-5507e9da2b59 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:34.582638 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821775-2597-4014-bcf0-5507e9da2b59 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:34.582829 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821775-2597-4014-bcf0-5507e9da2b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:34.603052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fd821775-2597-4014-bcf0-5507e9da2b59 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:34.604475 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd821775-2597-4014-bcf0-5507e9da2b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:34.614191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1285/2575] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:34.634451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:34.655471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de63a-6c62-4506-bbb8-452a349221ef service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:34.662193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:34.662975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:34.663473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:34.663998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:34.673343 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:34.675050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:34.686944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1291/2576] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:37.841270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ad3d4-8fea-49c9-a2c0-1d95afa015b3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:37.841727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ad3d4-8fea-49c9-a2c0-1d95afa015b3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:37.842681 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ad3d4-8fea-49c9-a2c0-1d95afa015b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:37.863905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-337ad3d4-8fea-49c9-a2c0-1d95afa015b3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:37.865398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-337ad3d4-8fea-49c9-a2c0-1d95afa015b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:37.873764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1286/2577] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:37.893937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:37.906291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d632a-978e-4abe-bddc-30cad684ff7b service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:37.911810 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:37.912410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:37.912687 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:37.913032 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:37.922041 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:37.923671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:37.933416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1292/2578] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:39.306869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69dff3-dd03-4337-80b6-3ad215ddfc06 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:39.307762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69dff3-dd03-4337-80b6-3ad215ddfc06 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:39.308238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69dff3-dd03-4337-80b6-3ad215ddfc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:39.333635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9f69dff3-dd03-4337-80b6-3ad215ddfc06 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:39.334888 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9f69dff3-dd03-4337-80b6-3ad215ddfc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:39.342627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1287/2579] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:38:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:38:39.363763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:39.375874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642ca6e-20af-4afa-997d-2a0010f1505b service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:39.381325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:39.381927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:39.382209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:39.382595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:39.396297 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:39.398084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:39.401866 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:39.408820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1293/2580] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:38:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:38:41.013520 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd68b-de9c-4890-8744-30de968095c2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:41.014103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd68b-de9c-4890-8744-30de968095c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:41.014309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd68b-de9c-4890-8744-30de968095c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:41.037275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3b5dd68b-de9c-4890-8744-30de968095c2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:41.038686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3b5dd68b-de9c-4890-8744-30de968095c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:41.049901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1288/2581] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:41.070166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:41.083029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571151e-2967-42a5-8f33-f578a4783b2c service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:41.088879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc92c-3187-484a-a711-acfdaf861c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:41.089706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc92c-3187-484a-a711-acfdaf861c57 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:41.090172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc92c-3187-484a-a711-acfdaf861c57 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:41.090648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc92c-3187-484a-a711-acfdaf861c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:41.099661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc92c-3187-484a-a711-acfdaf861c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:41.101253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc92c-3187-484a-a711-acfdaf861c57 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:41.112146 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1294/2582] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:51.030178 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=58 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:51.106977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:52.430915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d9e8a-8253-4f0a-b1ac-1fad135e04b8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:52.431359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d9e8a-8253-4f0a-b1ac-1fad135e04b8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:52.431492 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d9e8a-8253-4f0a-b1ac-1fad135e04b8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:52.433253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1289/2583] 10.222.0.52 () {54 vars in 961 bytes} [Sun Sep 25 04:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:38:52.438426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed874dc-1f09-4aca-992e-b0c46f72a97d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:52.438897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed874dc-1f09-4aca-992e-b0c46f72a97d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:52.438978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed874dc-1f09-4aca-992e-b0c46f72a97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:52.462460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5ed874dc-1f09-4aca-992e-b0c46f72a97d None None] MFA Rules not processed for user `e7dd8be65a664bba8a5b326943158418`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:52.464622 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5ed874dc-1f09-4aca-992e-b0c46f72a97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:52.532301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1295/2584] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Sep 25 04:38:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:52.540184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d9e8a-8253-4f0a-b1ac-1fad135e04b8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:52.554910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d9e8a-8253-4f0a-b1ac-1fad135e04b8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:52.559990 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4d5d-6911-4a63-a536-483291e537d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:52.561203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4d5d-6911-4a63-a536-483291e537d1 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:52.561593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4d5d-6911-4a63-a536-483291e537d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:52.561931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4d5d-6911-4a63-a536-483291e537d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:52.563854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c7bc4d5d-6911-4a63-a536-483291e537d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:52.576166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4d5d-6911-4a63-a536-483291e537d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:52.578359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4d5d-6911-4a63-a536-483291e537d1 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:52.589145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1290/2585] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:56.276219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff5a6-b74c-49ac-9d5a-58cea8357fef None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.276779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff5a6-b74c-49ac-9d5a-58cea8357fef None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.276779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff5a6-b74c-49ac-9d5a-58cea8357fef None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.278302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1296/2586] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:38:56.284987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb84b3-88c2-4bd0-9a3a-e24fa82048df None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.285448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb84b3-88c2-4bd0-9a3a-e24fa82048df None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.285448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb84b3-88c2-4bd0-9a3a-e24fa82048df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.305798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-52bb84b3-88c2-4bd0-9a3a-e24fa82048df None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:56.307211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-52bb84b3-88c2-4bd0-9a3a-e24fa82048df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:56.317868 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1291/2587] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:38:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:56.330184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff5a6-b74c-49ac-9d5a-58cea8357fef None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:56.342258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-902ff5a6-b74c-49ac-9d5a-58cea8357fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:56.409532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff5a6-b74c-49ac-9d5a-58cea8357fef None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:56.413171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b8c2b-bdbf-4def-941d-713f877360b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:56.413791 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b8c2b-bdbf-4def-941d-713f877360b9 service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.414074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b8c2b-bdbf-4def-941d-713f877360b9 service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.414367 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b8c2b-bdbf-4def-941d-713f877360b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.428138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b8c2b-bdbf-4def-941d-713f877360b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:56.429609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b8c2b-bdbf-4def-941d-713f877360b9 service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:56.441037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1297/2588] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:38:56.512030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667706ba-4aed-4c92-9b07-529009055227 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.512330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667706ba-4aed-4c92-9b07-529009055227 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.512631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667706ba-4aed-4c92-9b07-529009055227 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.514070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1292/2589] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 04:38:56.518817 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7859c91-015d-4007-b061-f8a2914375dc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.519111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7859c91-015d-4007-b061-f8a2914375dc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.519395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7859c91-015d-4007-b061-f8a2914375dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.663856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f7859c91-015d-4007-b061-f8a2914375dc None None] MFA Rules not processed for user `d4f75c3e044d4b0dbad6b16ea0599bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:56.665093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f7859c91-015d-4007-b061-f8a2914375dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:56.672644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1298/2590] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:38:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:56.685057 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667706ba-4aed-4c92-9b07-529009055227 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:56.686856 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-667706ba-4aed-4c92-9b07-529009055227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:56.700332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667706ba-4aed-4c92-9b07-529009055227 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:56.704405 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571ea44-cbca-4bf8-8ff8-82b24a0a1748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:56.704988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ea44-cbca-4bf8-8ff8-82b24a0a1748 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.705268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ea44-cbca-4bf8-8ff8-82b24a0a1748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.705542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ea44-cbca-4bf8-8ff8-82b24a0a1748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.712654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571ea44-cbca-4bf8-8ff8-82b24a0a1748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:56.714080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571ea44-cbca-4bf8-8ff8-82b24a0a1748 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:56.722568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1293/2591] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:56.812195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3133-7a9a-4437-9021-20eb1f6114d9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.812419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3133-7a9a-4437-9021-20eb1f6114d9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.812695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3133-7a9a-4437-9021-20eb1f6114d9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.814019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1299/2592] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:38:56.819140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da9de-7084-40b3-b70a-a79bbd27f98a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.819425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da9de-7084-40b3-b70a-a79bbd27f98a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.819700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da9de-7084-40b3-b70a-a79bbd27f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.839383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b91da9de-7084-40b3-b70a-a79bbd27f98a None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:56.840587 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b91da9de-7084-40b3-b70a-a79bbd27f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:56.850756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1294/2593] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:38:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:56.861787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3133-7a9a-4437-9021-20eb1f6114d9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:56.872714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3133-7a9a-4437-9021-20eb1f6114d9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:56.877089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c956823-a48b-43be-8622-697f4611e9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:56.877696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c956823-a48b-43be-8622-697f4611e9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:56.877974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c956823-a48b-43be-8622-697f4611e9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:56.878248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c956823-a48b-43be-8622-697f4611e9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:56.888219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c956823-a48b-43be-8622-697f4611e9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:56.889639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c956823-a48b-43be-8622-697f4611e9e0 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:56.901221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1300/2594] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:38:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:38:59.024387 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc93b-804f-4a70-80c0-ee19fc37676e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:59.024946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc93b-804f-4a70-80c0-ee19fc37676e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:59.025102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc93b-804f-4a70-80c0-ee19fc37676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:59.044217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-32efc93b-804f-4a70-80c0-ee19fc37676e None None] MFA Rules not processed for user `8f9c04c24aea453fb3957fbaa4475b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:59.045915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-32efc93b-804f-4a70-80c0-ee19fc37676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:59.100687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1295/2595] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:38:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:59.173050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ccf9-ac20-4f6c-9486-fe8b523f4dc2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:59.173521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ccf9-ac20-4f6c-9486-fe8b523f4dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:59.173640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ccf9-ac20-4f6c-9486-fe8b523f4dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:59.192147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a9b6ccf9-ac20-4f6c-9486-fe8b523f4dc2 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:38:59.193348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a9b6ccf9-ac20-4f6c-9486-fe8b523f4dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:38:59.200703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1301/2596] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:38:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:38:59.213279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc93b-804f-4a70-80c0-ee19fc37676e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:38:59.225103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc93b-804f-4a70-80c0-ee19fc37676e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:38:59.230655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da11a-32ca-46db-bc69-b37103cd091a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:38:59.231285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da11a-32ca-46db-bc69-b37103cd091a service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:38:59.231561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da11a-32ca-46db-bc69-b37103cd091a service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:38:59.231833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da11a-32ca-46db-bc69-b37103cd091a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:38:59.240967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da11a-32ca-46db-bc69-b37103cd091a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:38:59.242567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da11a-32ca-46db-bc69-b37103cd091a service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:38:59.250760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1296/2597] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:38:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:39:09.187172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=67 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:09.247380 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=49 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:11.803235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41801-c319-4139-99a0-de6b85d7055f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:11.803801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41801-c319-4139-99a0-de6b85d7055f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:11.803909 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41801-c319-4139-99a0-de6b85d7055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:11.824088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-12b41801-c319-4139-99a0-de6b85d7055f None None] MFA Rules not processed for user `5bdeb69b2259462b90c34aede652f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:39:11.825280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-12b41801-c319-4139-99a0-de6b85d7055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:39:11.885631 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1302/2598] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:39:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:39:18.348550 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28314518-1da9-48e6-bb84-4ed28e265bc7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:18.349052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28314518-1da9-48e6-bb84-4ed28e265bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:18.349145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28314518-1da9-48e6-bb84-4ed28e265bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:18.369627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-28314518-1da9-48e6-bb84-4ed28e265bc7 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:39:18.370977 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-28314518-1da9-48e6-bb84-4ed28e265bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:39:18.386097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1297/2599] 10.222.0.52 () {58 vars in 967 bytes} [Sun Sep 25 04:39:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:39:18.399387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41801-c319-4139-99a0-de6b85d7055f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:39:18.415576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41801-c319-4139-99a0-de6b85d7055f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:39:18.425835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:39:18.426621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:18.426977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:18.427450 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:18.436860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:39:18.438514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:39:18.446904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1303/2600] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:39:27.093374 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49094b3-4cea-4b4f-99d8-4bae86fc3683 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:27.093956 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49094b3-4cea-4b4f-99d8-4bae86fc3683 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:27.093956 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49094b3-4cea-4b4f-99d8-4bae86fc3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:27.113111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b49094b3-4cea-4b4f-99d8-4bae86fc3683 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:39:27.114332 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b49094b3-4cea-4b4f-99d8-4bae86fc3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:39:27.122633 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1298/2601] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:39:27.136165 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:39:27.148605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64305-4b5a-4a73-bb61-d1e1badb79b7 service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:39:27.153987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:39:27.154613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:27.154895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:27.155167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:27.163317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:39:27.165031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:39:27.174223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1304/2602] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:39:30.382601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbc01-d484-4540-96f5-72251974245d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:30.383168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbc01-d484-4540-96f5-72251974245d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:30.383168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbc01-d484-4540-96f5-72251974245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:30.403209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-38ecbc01-d484-4540-96f5-72251974245d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:39:30.404509 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-38ecbc01-d484-4540-96f5-72251974245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:39:30.412865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1299/2603] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:39:30.448983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:39:30.459802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b0780-cc2d-4381-88eb-58ce078a7137 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:39:30.465534 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:39:30.466124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:30.466428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:30.466702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:30.474925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:39:30.476305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:39:30.486421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1305/2604] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:39:33.446011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74859e-5d38-4b59-8fbe-22ba42d80f71 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:33.446489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74859e-5d38-4b59-8fbe-22ba42d80f71 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:33.446599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74859e-5d38-4b59-8fbe-22ba42d80f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:33.465896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3d74859e-5d38-4b59-8fbe-22ba42d80f71 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:39:33.467157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3d74859e-5d38-4b59-8fbe-22ba42d80f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:39:33.475481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1300/2605] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:39:33.503798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:39:33.515426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7222df-acf7-449b-8e1c-1ab702b932ee service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:39:33.520827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:39:33.521466 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:33.521744 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:33.522016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:33.529934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:39:33.531544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:39:33.541307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1306/2606] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:39:36.603775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b9369-2c49-4f9d-b40b-a373ed91389b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:36.604253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b9369-2c49-4f9d-b40b-a373ed91389b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:36.604381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b9369-2c49-4f9d-b40b-a373ed91389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:36.624107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2d8b9369-2c49-4f9d-b40b-a373ed91389b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:39:36.625311 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d8b9369-2c49-4f9d-b40b-a373ed91389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:39:36.633136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1301/2607] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:39:36.648326 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:39:36.660627 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed50ed-3550-4ecd-ba7f-0e99e6c34519 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:39:36.666486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:39:36.667093 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:36.667369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:36.667642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:36.681535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:39:36.683190 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:39:36.693281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1307/2608] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:39:39.770237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80139cd-939e-4fb7-8a42-202bc54e01a5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:39.770715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80139cd-939e-4fb7-8a42-202bc54e01a5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:39.770806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80139cd-939e-4fb7-8a42-202bc54e01a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:39.778394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=16 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:39.791753 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f80139cd-939e-4fb7-8a42-202bc54e01a5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:39:39.792951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f80139cd-939e-4fb7-8a42-202bc54e01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:39:39.800819 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1302/2609] 10.222.0.49 () {58 vars in 1016 bytes} [Sun Sep 25 04:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:39:39.817983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:39:39.824033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=56 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:39.830592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dea4e-0e76-4027-9eea-3c26031d1b97 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:39:39.836019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:39:39.836611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:39:39.836894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:39:39.837167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:39:39.845099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:39:39.847292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:39:39.856448 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1308/2610] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:39:49.786390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:49.852423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:10.161636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3325-4926-4595-bb95-76494e689d68 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:10.162154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3325-4926-4595-bb95-76494e689d68 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:10.162252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3325-4926-4595-bb95-76494e689d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:10.182611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c23f3325-4926-4595-bb95-76494e689d68 None None] MFA Rules not processed for user `a9a2d9f4d9a0464789c9e761f48a4e68`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:10.183845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c23f3325-4926-4595-bb95-76494e689d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:10.205659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:10.207186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:10.221316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d977fd-95c1-4128-8fab-c256825a669a service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:10.228747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:10.229625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:10.230053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:10.230843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] PATH_INFO: `/v3/users/8f9c04c24aea453fb3957fbaa4475b18` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:10.232169 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9c04c24aea453fb3957fbaa4475b18)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:10.234263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:10.251894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1303/2611] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:10.300518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9c04c24aea453fb3957fbaa4475b18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.309725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9c04c24aea453fb3957fbaa4475b18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.310518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9c04c24aea453fb3957fbaa4475b18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.311234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9c04c24aea453fb3957fbaa4475b18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.326043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0c14808-ccc4-42ac-899c-1f78851497f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9c04c24aea453fb3957fbaa4475b18'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.347985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1309/2612] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:10 2022] DELETE /identity/v3/users/8f9c04c24aea453fb3957fbaa4475b18 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:10.683220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3325-4926-4595-bb95-76494e689d68 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:10.695018 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3325-4926-4595-bb95-76494e689d68 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:10.768345 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:10.769075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:10.769425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:10.769769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] PATH_INFO: `/v3/projects/a9a1df0a1db54645aeb56a987a57e658` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:10.770975 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a1df0a1db54645aeb56a987a57e658)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:10.773275 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:10.831506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a1df0a1db54645aeb56a987a57e658', 'request_id': 'req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.838238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a1df0a1db54645aeb56a987a57e658', 'request_id': 'req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.850038 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a1df0a1db54645aeb56a987a57e658', 'request_id': 'req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.864680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] The token cache is being invalidate because project a9a1df0a1db54645aeb56a987a57e658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:10.865125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.866335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2fc5bf1e-30c1-4beb-a5c3-1f25f6e918a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:10.868193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1304/2613] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:10 2022] DELETE /identity/v3/projects/a9a1df0a1db54645aeb56a987a57e658 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:10.873172 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d019328-03f0-41ed-844f-baa7b080df9a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:10.873725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d019328-03f0-41ed-844f-baa7b080df9a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:10.874403 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d019328-03f0-41ed-844f-baa7b080df9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:10.906393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4d019328-03f0-41ed-844f-baa7b080df9a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:10.908191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4d019328-03f0-41ed-844f-baa7b080df9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:10.976022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1310/2614] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:10.977719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b2ee-1579-4ca7-b97a-c77198ebaf3e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:10.978066 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b2ee-1579-4ca7-b97a-c77198ebaf3e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:10.978313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b2ee-1579-4ca7-b97a-c77198ebaf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.003051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aaf2b2ee-1579-4ca7-b97a-c77198ebaf3e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:11.003051 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aaf2b2ee-1579-4ca7-b97a-c77198ebaf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:11.012231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1305/2615] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:11.015164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d019328-03f0-41ed-844f-baa7b080df9a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:11.026034 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d019328-03f0-41ed-844f-baa7b080df9a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:11.030902 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:11.031675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.031953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.032896 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.033474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:40:11.034019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:11.035789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:11.053106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1311/2616] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:40:11.054942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b2ee-1579-4ca7-b97a-c77198ebaf3e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:11.064943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b2ee-1579-4ca7-b97a-c77198ebaf3e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:11.073359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:11.074082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.074385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.075152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.076047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:11.079946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:11.109737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1306/2617] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:11 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:11.114522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:11.124374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14313-a355-40a7-8864-d200ac74abb1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:11.183612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:11.184206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.184506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.184758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.185395 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:11.187346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:11.196390 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:11.212331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1312/2618] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:11 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:11.216704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:11.227186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619eb9-ab87-41c5-8472-333bf9e41989 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:11.232635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:11.233495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.233844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.234121 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.234812 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:11.237138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:11.238660 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:11.253825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1307/2619] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:40:11.255155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:11.266214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1d9b-a4ee-44d9-a9bb-732ffc01ab5c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:11.271338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b063a-b4dd-45b3-a72f-8845d5b48e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:11.272138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b063a-b4dd-45b3-a72f-8845d5b48e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.272423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b063a-b4dd-45b3-a72f-8845d5b48e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.272703 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b063a-b4dd-45b3-a72f-8845d5b48e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.273349 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b063a-b4dd-45b3-a72f-8845d5b48e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:11.274994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b063a-b4dd-45b3-a72f-8845d5b48e0d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:11.285517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1313/2620] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:11.289708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:11.300739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb77db-e95f-4909-b070-e7385aa578f8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:11.306044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:11.306828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.307288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.307491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] PATH_INFO: `/v3/projects/492d5c3ac698487ab3e680cb478f62cd/users/8a17c3ae836d4f439e07691c257c681e/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.323181 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492d5c3ac698487ab3e680cb478f62cd, user_id=8a17c3ae836d4f439e07691c257c681e, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:11.325897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:11.340131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1308/2621] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:11 2022] PUT /identity/v3/projects/492d5c3ac698487ab3e680cb478f62cd/users/8a17c3ae836d4f439e07691c257c681e/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:11.351416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a79508-17cf-42a5-931b-205e435bb005 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.351706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a79508-17cf-42a5-931b-205e435bb005 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.351983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a79508-17cf-42a5-931b-205e435bb005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.381285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-83a79508-17cf-42a5-931b-205e435bb005 None None] MFA Rules not processed for user `8a17c3ae836d4f439e07691c257c681e`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:11.382541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-83a79508-17cf-42a5-931b-205e435bb005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:11.460898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1314/2622] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:11.472266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:11.474094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:11.532016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d4dc4-b619-4b57-a70e-229f968394e1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:11.536661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df2e26-fe59-4c90-a3ea-a111e6601a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:11.537257 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df2e26-fe59-4c90-a3ea-a111e6601a64 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:11.537535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df2e26-fe59-4c90-a3ea-a111e6601a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:11.537803 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df2e26-fe59-4c90-a3ea-a111e6601a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:11.546010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df2e26-fe59-4c90-a3ea-a111e6601a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:11.547470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df2e26-fe59-4c90-a3ea-a111e6601a64 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:11.556862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1309/2623] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:16.770647 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a79508-17cf-42a5-931b-205e435bb005 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:16.843251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a79508-17cf-42a5-931b-205e435bb005 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:16.849258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:16.850323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:16.850854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:16.851141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] PATH_INFO: `/v3/users/8a17c3ae836d4f439e07691c257c681e` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:16.852352 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a17c3ae836d4f439e07691c257c681e)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:16.854287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:16.915486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a17c3ae836d4f439e07691c257c681e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:16.926846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a17c3ae836d4f439e07691c257c681e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:16.929021 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a17c3ae836d4f439e07691c257c681e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:16.929669 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a17c3ae836d4f439e07691c257c681e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:16.953264 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a17c3ae836d4f439e07691c257c681e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:16.967560 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:16.997023 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1315/2624] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:16 2022] DELETE /identity/v3/users/8a17c3ae836d4f439e07691c257c681e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:17.000352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:17.000904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:17.001004 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:17.025176 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:17.026464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:17.109396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1310/2625] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:17.127821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:17.129508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:17.216965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0714bb5-4313-419c-9049-dcf11ffd51d4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:17.222816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:17.223431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:17.223711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:17.223983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:17.233378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:17.234863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:17.245218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1316/2626] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:17.781727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:17.783863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:17.797281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453ab53-8507-42a2-bdcb-c58cfc90b572 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:17.803233 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:17.804369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:17.804661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:17.804944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] PATH_INFO: `/v3/projects/492d5c3ac698487ab3e680cb478f62cd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:17.806415 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=492d5c3ac698487ab3e680cb478f62cd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:17.808546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:17.865212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492d5c3ac698487ab3e680cb478f62cd', 'request_id': 'req-5a09db9c-38ee-4513-997a-4b2a5660ea4b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:17.871900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492d5c3ac698487ab3e680cb478f62cd', 'request_id': 'req-5a09db9c-38ee-4513-997a-4b2a5660ea4b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:17.881723 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492d5c3ac698487ab3e680cb478f62cd', 'request_id': 'req-5a09db9c-38ee-4513-997a-4b2a5660ea4b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:17.893789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:17.898842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] The token cache is being invalidate because project 492d5c3ac698487ab3e680cb478f62cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:17.899646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:17.900515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:17.902137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1311/2627] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:17 2022] DELETE /identity/v3/projects/492d5c3ac698487ab3e680cb478f62cd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:21.800202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:21.801699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:21.815974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eadce-cce7-4e51-9ffb-b27bffd7c237 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:21.870967 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:21.871601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:21.871881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:21.872155 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] PATH_INFO: `/v3/users/5bdeb69b2259462b90c34aede652f5f1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:21.873285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdeb69b2259462b90c34aede652f5f1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:21.875229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:21.920774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdeb69b2259462b90c34aede652f5f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:21.928702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdeb69b2259462b90c34aede652f5f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:21.929315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdeb69b2259462b90c34aede652f5f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:21.929912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdeb69b2259462b90c34aede652f5f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:21.937101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1a3335e-3ed9-405b-ae4b-7ecdfbb91e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdeb69b2259462b90c34aede652f5f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:21.958706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1317/2628] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:21 2022] DELETE /identity/v3/users/5bdeb69b2259462b90c34aede652f5f1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:22.128101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.129722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:22.145602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09db9c-38ee-4513-997a-4b2a5660ea4b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.210962 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.212005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.212588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.213239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] PATH_INFO: `/v3/projects/30bd905ba8034b5f8ac50d93d9eac570` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.214390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bd905ba8034b5f8ac50d93d9eac570)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.216532 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.277152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bd905ba8034b5f8ac50d93d9eac570', 'request_id': 'req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:22.283375 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bd905ba8034b5f8ac50d93d9eac570', 'request_id': 'req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:22.290739 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bd905ba8034b5f8ac50d93d9eac570', 'request_id': 'req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:22.301274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] The token cache is being invalidate because project 30bd905ba8034b5f8ac50d93d9eac570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:22.301563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:22.302196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f0cfc35a-d5d5-4e4c-82aa-37c7b4e7a3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:22.303735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1312/2629] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:22 2022] DELETE /identity/v3/projects/30bd905ba8034b5f8ac50d93d9eac570 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:22.308581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24651f-c168-4288-b825-c33db68a8419 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.308868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24651f-c168-4288-b825-c33db68a8419 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.309144 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24651f-c168-4288-b825-c33db68a8419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.331200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fe24651f-c168-4288-b825-c33db68a8419 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:22.332417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fe24651f-c168-4288-b825-c33db68a8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:22.338044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:22.403459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1318/2630] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:22.411282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43840-702c-4fb0-b582-4a664cff0fe6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.411574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43840-702c-4fb0-b582-4a664cff0fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.411856 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43840-702c-4fb0-b582-4a664cff0fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.433539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ccb43840-702c-4fb0-b582-4a664cff0fe6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:22.434902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ccb43840-702c-4fb0-b582-4a664cff0fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:22.445940 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1313/2631] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:22.450539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24651f-c168-4288-b825-c33db68a8419 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.460733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24651f-c168-4288-b825-c33db68a8419 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.465440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.466051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.466331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.466635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.467286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:40:22.467593 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.469215 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.481469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1319/2632] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:40:22.486428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43840-702c-4fb0-b582-4a664cff0fe6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.495694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43840-702c-4fb0-b582-4a664cff0fe6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.500378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.501526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.501799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.502071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.502740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.504680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.532664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1314/2633] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:22 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:40:22.536960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.547268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d9737-e2c4-41f0-b32f-7571bb416991 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.608323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.609920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.609920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.609920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.610971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.613062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.636765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1320/2634] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:22 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:22.641279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.652256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048de6-62f3-49bc-bf9b-890695df946e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.657236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.657845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.658123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.658524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.659228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.662648 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.676071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1315/2635] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:22.679982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.691009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10e2b7-4ad2-4680-9859-77f1ad8f950d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.696031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f133d8-36a1-4bc2-9c23-a544463c569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.696638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f133d8-36a1-4bc2-9c23-a544463c569d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.696915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f133d8-36a1-4bc2-9c23-a544463c569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.697186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f133d8-36a1-4bc2-9c23-a544463c569d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.698082 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f133d8-36a1-4bc2-9c23-a544463c569d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.699697 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f133d8-36a1-4bc2-9c23-a544463c569d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.711170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1321/2636] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:22.715194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.725830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f82fb-6737-4f50-9952-09908c20aa5a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.727138 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.727424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.727695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.730656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906f05f-2bfa-4786-80f9-29de704f9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.731302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906f05f-2bfa-4786-80f9-29de704f9752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.731585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906f05f-2bfa-4786-80f9-29de704f9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.731875 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906f05f-2bfa-4786-80f9-29de704f9752 admin admin] PATH_INFO: `/v3/projects/c721bf11caf94453b720755854413a72/users/33e160e0035f48b68ffc8d9931e83cff/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.747430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:22.747596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906f05f-2bfa-4786-80f9-29de704f9752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c721bf11caf94453b720755854413a72, user_id=33e160e0035f48b68ffc8d9931e83cff, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.748646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:22.750145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906f05f-2bfa-4786-80f9-29de704f9752 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.765069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1316/2637] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:22 2022] PUT /identity/v3/projects/c721bf11caf94453b720755854413a72/users/33e160e0035f48b68ffc8d9931e83cff/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:22.775092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.775456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.775820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.804546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] MFA Rules not processed for user `33e160e0035f48b68ffc8d9931e83cff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:22.806042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:22.807083 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1322/2638] 10.222.0.52 () {58 vars in 967 bytes} [Sun Sep 25 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:40:22.818359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:22.857621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.859331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:22.879800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1317/2639] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:40:22.882286 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:22.890765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:22.892251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:22.936702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88a3e-1c2c-4c06-bcf2-4962c27c277f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.975684 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d60370-e6b4-4ad7-b255-e99fcadacf89 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:22.981591 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.982209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.982526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.982806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:22.991252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:22.992904 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:22.998330 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef4f55-6995-492d-b64d-10be2b9b2471 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:22.998958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef4f55-6995-492d-b64d-10be2b9b2471 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:22.999237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef4f55-6995-492d-b64d-10be2b9b2471 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:22.999512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef4f55-6995-492d-b64d-10be2b9b2471 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:23.002088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1318/2640] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:40:23.064333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef4f55-6995-492d-b64d-10be2b9b2471 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:23.065935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef4f55-6995-492d-b64d-10be2b9b2471 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:23.074667 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1323/2641] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 04:40:23.222843 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:23.303076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c4d42-61ed-412c-b311-4ecfed7f1834 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:23.308009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:23.308726 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:23.309078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:23.309422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] PATH_INFO: `/v3/users/33e160e0035f48b68ffc8d9931e83cff` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:23.310645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e160e0035f48b68ffc8d9931e83cff)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:23.312661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:23.365428 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:23.374432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e160e0035f48b68ffc8d9931e83cff'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:23.375136 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e160e0035f48b68ffc8d9931e83cff'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:23.383336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e160e0035f48b68ffc8d9931e83cff'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:23.391281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e160e0035f48b68ffc8d9931e83cff'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:23.404434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e160e0035f48b68ffc8d9931e83cff'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:23.414399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1319/2642] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:23 2022] DELETE /identity/v3/users/33e160e0035f48b68ffc8d9931e83cff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:23.416145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:23.416642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:23.416921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:23.438338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:23.439586 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:23.520332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1324/2643] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:23.529931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:23.531379 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:23.591183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102de64-4bb1-4a03-b848-c12f8d657aeb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:23.595395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09c2d0-1f8a-433c-a068-15a92a4e1819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:23.596005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c2d0-1f8a-433c-a068-15a92a4e1819 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:23.596284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c2d0-1f8a-433c-a068-15a92a4e1819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:23.596589 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c2d0-1f8a-433c-a068-15a92a4e1819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:23.608132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09c2d0-1f8a-433c-a068-15a92a4e1819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:23.609627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09c2d0-1f8a-433c-a068-15a92a4e1819 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:23.620801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1320/2644] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:23.916237 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:23.917765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:23.929711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:23.937532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec5e3-02e5-4f6d-891b-91041d16f6f7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:23.951240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:23.951984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:23.952296 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:23.952599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] PATH_INFO: `/v3/projects/c721bf11caf94453b720755854413a72` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:23.954164 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c721bf11caf94453b720755854413a72)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:23.956128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.024464 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c721bf11caf94453b720755854413a72', 'request_id': 'req-74adebb8-faa0-42e8-ab64-5b724431a8a1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:24.030901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c721bf11caf94453b720755854413a72', 'request_id': 'req-74adebb8-faa0-42e8-ab64-5b724431a8a1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:24.039274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c721bf11caf94453b720755854413a72', 'request_id': 'req-74adebb8-faa0-42e8-ab64-5b724431a8a1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:24.051995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] The token cache is being invalidate because project c721bf11caf94453b720755854413a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:24.052369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:24.053420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-74adebb8-faa0-42e8-ab64-5b724431a8a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:24.054947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1325/2645] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:23 2022] DELETE /identity/v3/projects/c721bf11caf94453b720755854413a72 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:24.059997 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756079-1973-4f48-89bb-e4bf09ecd270 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.060296 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756079-1973-4f48-89bb-e4bf09ecd270 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.060594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756079-1973-4f48-89bb-e4bf09ecd270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.081322 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aa756079-1973-4f48-89bb-e4bf09ecd270 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:24.082590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa756079-1973-4f48-89bb-e4bf09ecd270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:24.143141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1321/2646] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:24.152436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383fc5a-7f93-4d08-aa6e-b082d54fef08 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.152721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383fc5a-7f93-4d08-aa6e-b082d54fef08 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.152999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383fc5a-7f93-4d08-aa6e-b082d54fef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.172906 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0383fc5a-7f93-4d08-aa6e-b082d54fef08 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:24.174024 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0383fc5a-7f93-4d08-aa6e-b082d54fef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:24.181952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1326/2647] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:24.186191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756079-1973-4f48-89bb-e4bf09ecd270 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.196043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756079-1973-4f48-89bb-e4bf09ecd270 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.201099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.201712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.201991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.202260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.203013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:40:24.203316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.205486 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.221206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1322/2648] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:40:24.222377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383fc5a-7f93-4d08-aa6e-b082d54fef08 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.232052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383fc5a-7f93-4d08-aa6e-b082d54fef08 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.236914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.237584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.237930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.238269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.238996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.240975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.282258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1327/2649] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:24 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:24.283542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.294536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b66fd-6fee-44b6-9a16-ea6d4b034b09 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.352159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:24.371654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.372464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.372914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.373191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.373836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.377342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.404165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1323/2650] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:24 2022] POST /identity/v3/users => generated 303 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:24.405373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.415822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e99dd-8e63-4af5-80f8-0380f26e0fdb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.420406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.421031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.421305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.421575 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.422206 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.423907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.434006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1328/2651] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:40:24.438615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.449075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef7334-b441-422c-a0d6-627efb0a60ec admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.454667 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0bfde-0ead-4a20-b40e-a8830c5abc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.455470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0bfde-0ead-4a20-b40e-a8830c5abc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.456124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0bfde-0ead-4a20-b40e-a8830c5abc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.456401 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0bfde-0ead-4a20-b40e-a8830c5abc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.457075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0bfde-0ead-4a20-b40e-a8830c5abc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.458716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0bfde-0ead-4a20-b40e-a8830c5abc19 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.472781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1324/2652] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:24.476844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.489090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffcc6b-3d9f-4cd6-bcaf-6163d9501318 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.495504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.497376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.497376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.497376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] PATH_INFO: `/v3/projects/0632479e22d54d34ba2a5e31bc06f299/users/66c2df97917b4fc6bd89323e8a81ef67/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.514380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0632479e22d54d34ba2a5e31bc06f299, user_id=66c2df97917b4fc6bd89323e8a81ef67, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.518087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.532616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1329/2653] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:24 2022] PUT /identity/v3/projects/0632479e22d54d34ba2a5e31bc06f299/users/66c2df97917b4fc6bd89323e8a81ef67/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:24.543436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a493b9-1bfc-422e-baf4-95d9e48cb99c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.543757 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a493b9-1bfc-422e-baf4-95d9e48cb99c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.544075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a493b9-1bfc-422e-baf4-95d9e48cb99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.574529 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f7a493b9-1bfc-422e-baf4-95d9e48cb99c None None] MFA Rules not processed for user `66c2df97917b4fc6bd89323e8a81ef67`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:24.575842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f7a493b9-1bfc-422e-baf4-95d9e48cb99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:24.647012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1325/2654] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:24.651651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.732809 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529228b-3f8e-4dea-9f90-e476a8c74f5a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.738261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.739020 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.739332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.739619 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.740263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.742258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.773451 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1330/2655] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:24 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:24.777285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a493b9-1bfc-422e-baf4-95d9e48cb99c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.789097 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a493b9-1bfc-422e-baf4-95d9e48cb99c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.856849 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.857629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.858082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.858531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.859402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.862065 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.899141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1326/2656] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:24 2022] POST /identity/v3/users => generated 309 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:24.903114 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.921173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271933-04e3-4246-bda0-01d2401db734 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.928802 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.929433 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.929716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.929989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:24.930903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:24.932637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:24.935745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:24.948569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1331/2657] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:24.953410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:24.974049 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321837dc-6d08-4052-84ad-92678111e1b6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:24.983357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:24.984289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:24.984580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:24.984892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] PATH_INFO: `/v3/projects/0b2a5d2ac11a4402a452fa94cc0b6103/users/155172a2f75d40d9bbc7a3a1ca4d5625/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:25.006786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2a5d2ac11a4402a452fa94cc0b6103, user_id=155172a2f75d40d9bbc7a3a1ca4d5625, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:25.009556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:25.039357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1327/2658] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:24 2022] PUT /identity/v3/projects/0b2a5d2ac11a4402a452fa94cc0b6103/users/155172a2f75d40d9bbc7a3a1ca4d5625/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:40:25.041141 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:25.051366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a3bd3-cbdd-48cd-a182-f5a0dae370c1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:25.111789 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e1430-da98-4a74-9e26-8619d5b89584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:25.112497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1430-da98-4a74-9e26-8619d5b89584 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:25.112856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1430-da98-4a74-9e26-8619d5b89584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:25.113209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1430-da98-4a74-9e26-8619d5b89584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:25.113932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e1430-da98-4a74-9e26-8619d5b89584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:25.115767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e1430-da98-4a74-9e26-8619d5b89584 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:25.127126 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1332/2659] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:25.131203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:25.143321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6900-45a5-41db-b710-4405002ace45 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:25.148130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:25.149006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:25.149154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:25.149327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] PATH_INFO: `/v3/projects/0b2a5d2ac11a4402a452fa94cc0b6103/users/155172a2f75d40d9bbc7a3a1ca4d5625/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:25.151602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2a5d2ac11a4402a452fa94cc0b6103, user_id=155172a2f75d40d9bbc7a3a1ca4d5625, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:25.154292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:25.165245 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1328/2660] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:25 2022] PUT /identity/v3/projects/0b2a5d2ac11a4402a452fa94cc0b6103/users/155172a2f75d40d9bbc7a3a1ca4d5625/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:40:25.176265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4b36-ea46-465a-ac8a-06231fe79c71 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:25.176874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4b36-ea46-465a-ac8a-06231fe79c71 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:25.177101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4b36-ea46-465a-ac8a-06231fe79c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:25.208321 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-66dc4b36-ea46-465a-ac8a-06231fe79c71 None None] MFA Rules not processed for user `155172a2f75d40d9bbc7a3a1ca4d5625`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:25.209808 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-66dc4b36-ea46-465a-ac8a-06231fe79c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:25.301337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1333/2661] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:25.309924 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:25.311777 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:25.324390 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:25.393672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4904f-9e05-4cf2-b5c8-90e4bfd0a709 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:25.397472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f5560-028b-4761-bae6-01b36cc9d170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:25.398170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f5560-028b-4761-bae6-01b36cc9d170 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:25.398820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f5560-028b-4761-bae6-01b36cc9d170 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:25.399173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f5560-028b-4761-bae6-01b36cc9d170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:25.410694 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f5560-028b-4761-bae6-01b36cc9d170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:25.412360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f5560-028b-4761-bae6-01b36cc9d170 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:25.423697 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1329/2662] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:25 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:25.596747 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4b36-ea46-465a-ac8a-06231fe79c71 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:25.713355 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4b36-ea46-465a-ac8a-06231fe79c71 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:25.718832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:25.720128 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:25.720476 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:25.720824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] PATH_INFO: `/v3/users/66c2df97917b4fc6bd89323e8a81ef67` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:25.722201 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c2df97917b4fc6bd89323e8a81ef67)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:25.724985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:25.753375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:25.802117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c2df97917b4fc6bd89323e8a81ef67'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:25.815556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c2df97917b4fc6bd89323e8a81ef67'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:25.816273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c2df97917b4fc6bd89323e8a81ef67'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:25.816932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c2df97917b4fc6bd89323e8a81ef67'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:25.827724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c2df97917b4fc6bd89323e8a81ef67'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:25.854674 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1334/2663] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:25 2022] DELETE /identity/v3/users/66c2df97917b4fc6bd89323e8a81ef67 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:25.859506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:25.859840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:25.860125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:25.880974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:25.882611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:25.963231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1330/2664] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:25.977320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:25.979356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:26.077715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3274-dc5a-4de9-af0c-07db303435c4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:26.082832 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:26.083577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:26.083833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:26.084113 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:26.096513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:26.097997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:26.110874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1335/2665] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:26.777897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:26.779474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:26.792921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fde4b-08a5-4588-bb07-c72fae2c628c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:26.804662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:26.805708 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:26.806988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:26.807191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] PATH_INFO: `/v3/projects/0632479e22d54d34ba2a5e31bc06f299` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:26.816112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0632479e22d54d34ba2a5e31bc06f299)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:26.829414 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:26.896567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0632479e22d54d34ba2a5e31bc06f299', 'request_id': 'req-cb705185-80f8-40c6-b11f-8a3e810b97a4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:26.904022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0632479e22d54d34ba2a5e31bc06f299', 'request_id': 'req-cb705185-80f8-40c6-b11f-8a3e810b97a4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:26.914262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0632479e22d54d34ba2a5e31bc06f299', 'request_id': 'req-cb705185-80f8-40c6-b11f-8a3e810b97a4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:26.934310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] The token cache is being invalidate because project 0632479e22d54d34ba2a5e31bc06f299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:26.934880 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:26.935930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:26.941838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1331/2666] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:26 2022] DELETE /identity/v3/projects/0632479e22d54d34ba2a5e31bc06f299 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:26.943214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:26.966409 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7953a-390d-4c11-a1bc-169f79500291 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:27.037088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:27.037713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:27.037993 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:27.038263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] PATH_INFO: `/v3/users/155172a2f75d40d9bbc7a3a1ca4d5625` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:27.039785 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155172a2f75d40d9bbc7a3a1ca4d5625)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:27.041694 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:27.117269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:27.122648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155172a2f75d40d9bbc7a3a1ca4d5625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.138568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155172a2f75d40d9bbc7a3a1ca4d5625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.139682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155172a2f75d40d9bbc7a3a1ca4d5625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.140595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155172a2f75d40d9bbc7a3a1ca4d5625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.150734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b1fe5e27-02e2-4b4e-86f4-2a937b538b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155172a2f75d40d9bbc7a3a1ca4d5625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.176499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1336/2667] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:26 2022] DELETE /identity/v3/users/155172a2f75d40d9bbc7a3a1ca4d5625 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:27.690074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:27.691286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:27.708170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705185-80f8-40c6-b11f-8a3e810b97a4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:27.747848 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:27.777200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:27.777844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:27.778126 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:27.778696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] PATH_INFO: `/v3/projects/0b2a5d2ac11a4402a452fa94cc0b6103` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:27.779641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2a5d2ac11a4402a452fa94cc0b6103)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:27.781510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:27.831569 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2a5d2ac11a4402a452fa94cc0b6103', 'request_id': 'req-e6327573-dcb5-473a-96e3-a64a10632f31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.837827 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2a5d2ac11a4402a452fa94cc0b6103', 'request_id': 'req-e6327573-dcb5-473a-96e3-a64a10632f31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.845816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2a5d2ac11a4402a452fa94cc0b6103', 'request_id': 'req-e6327573-dcb5-473a-96e3-a64a10632f31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.856984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] The token cache is being invalidate because project 0b2a5d2ac11a4402a452fa94cc0b6103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:27.857402 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.858138 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e6327573-dcb5-473a-96e3-a64a10632f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:27.860579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1332/2668] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:27 2022] DELETE /identity/v3/projects/0b2a5d2ac11a4402a452fa94cc0b6103 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:27.865986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fbb03-a0d5-487e-9aa4-4068ff6f34cf None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:27.866279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fbb03-a0d5-487e-9aa4-4068ff6f34cf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:27.866591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fbb03-a0d5-487e-9aa4-4068ff6f34cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:27.886760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8d4fbb03-a0d5-487e-9aa4-4068ff6f34cf None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:27.887991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8d4fbb03-a0d5-487e-9aa4-4068ff6f34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:27.946603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1337/2669] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:27.954744 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee60e-b96d-457f-b453-c4eb5828b753 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:27.955060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee60e-b96d-457f-b453-c4eb5828b753 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:27.955344 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee60e-b96d-457f-b453-c4eb5828b753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:27.975148 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-215ee60e-b96d-457f-b453-c4eb5828b753 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:27.976365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-215ee60e-b96d-457f-b453-c4eb5828b753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:27.984578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1333/2670] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:27.989419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fbb03-a0d5-487e-9aa4-4068ff6f34cf None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:27.999048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fbb03-a0d5-487e-9aa4-4068ff6f34cf None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.004915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.005513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.005790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.006061 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.006730 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:40:28.007055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.008638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.021507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1338/2671] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:40:28.025954 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ee60e-b96d-457f-b453-c4eb5828b753 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.036223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ee60e-b96d-457f-b453-c4eb5828b753 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.040942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.041642 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.041987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.042327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.043056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.045027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.077305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1334/2672] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:40:28.078603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.088463 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92661d42-2c6e-4a6d-b0f1-08eaf4ac9498 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.145772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.146540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.146699 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.146982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.147754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.149723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.173018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1339/2673] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:28.177179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.187358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59116-d334-48da-8c82-a921ae7347a7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.192117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.192802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.193153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.193491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.194201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.195981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.206661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1335/2674] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:28.210719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.221947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fc05a-0e7b-4cf5-90ba-b5997190e817 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.226525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774db21d-c467-482e-af4f-5d770046ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.227123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774db21d-c467-482e-af4f-5d770046ce42 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.227401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774db21d-c467-482e-af4f-5d770046ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.227670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774db21d-c467-482e-af4f-5d770046ce42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.228310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774db21d-c467-482e-af4f-5d770046ce42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.230030 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774db21d-c467-482e-af4f-5d770046ce42 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.245265 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1340/2675] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:28.246499 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.257130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1028c8-3102-40bd-ae30-69e5d7ce7a02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.263677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.264459 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.264860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.265244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] PATH_INFO: `/v3/projects/234089f7b62e41e488f4d356ab6e2e97/users/ec54b7a6621049428cd18331481491be/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.282617 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234089f7b62e41e488f4d356ab6e2e97, user_id=ec54b7a6621049428cd18331481491be, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.285716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.299725 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1336/2676] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:28 2022] PUT /identity/v3/projects/234089f7b62e41e488f4d356ab6e2e97/users/ec54b7a6621049428cd18331481491be/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:28.309740 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba04c-8d15-4b87-84d1-c6248dadf57b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.310106 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba04c-8d15-4b87-84d1-c6248dadf57b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.310479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba04c-8d15-4b87-84d1-c6248dadf57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.338708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b35ba04c-8d15-4b87-84d1-c6248dadf57b None None] MFA Rules not processed for user `ec54b7a6621049428cd18331481491be`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:28.340228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b35ba04c-8d15-4b87-84d1-c6248dadf57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:28.353107 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:28.411181 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1341/2677] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:28.415790 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.483469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdf6d0-da11-45e9-8a78-9e49410d9fd8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.488937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.489562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.489841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.490113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.490799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.492721 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.498541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:28.531468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1337/2678] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:40:28.534063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ba04c-8d15-4b87-84d1-c6248dadf57b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.545200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ba04c-8d15-4b87-84d1-c6248dadf57b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.612428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.613195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.613599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.613971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.614753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.616980 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.647097 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1342/2679] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:28.651287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.662295 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9371-cc1f-41eb-9b19-ec4eee797642 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.667240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.667894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.668215 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.668510 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.669238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.670912 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.682607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1338/2680] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:28.686875 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.698443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507674e8-779c-4cbd-949a-c3bb8d8d92a1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.703329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067085-05bd-4d2f-bcc0-047d7e8c1824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.703959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067085-05bd-4d2f-bcc0-047d7e8c1824 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.704241 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067085-05bd-4d2f-bcc0-047d7e8c1824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.704516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067085-05bd-4d2f-bcc0-047d7e8c1824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.705291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067085-05bd-4d2f-bcc0-047d7e8c1824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.707084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067085-05bd-4d2f-bcc0-047d7e8c1824 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.721446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1343/2681] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:28.722762 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.733479 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ce3cd-8656-408f-a6f1-9365e9227085 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.738775 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.739447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.739754 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.740026 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] PATH_INFO: `/v3/projects/3ca196d25f4d443d96c3974f34c9d49a/users/0e55bc10b49c412baace53189eb25f2e/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.756662 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca196d25f4d443d96c3974f34c9d49a, user_id=0e55bc10b49c412baace53189eb25f2e, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.759385 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.774314 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1339/2682] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:28 2022] PUT /identity/v3/projects/3ca196d25f4d443d96c3974f34c9d49a/users/0e55bc10b49c412baace53189eb25f2e/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:28.786605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85f29-f2c4-4f0e-9a3b-ee90f75a8069 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.786895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85f29-f2c4-4f0e-9a3b-ee90f75a8069 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.787195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85f29-f2c4-4f0e-9a3b-ee90f75a8069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.818804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-07b85f29-f2c4-4f0e-9a3b-ee90f75a8069 None None] MFA Rules not processed for user `0e55bc10b49c412baace53189eb25f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:28.820064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-07b85f29-f2c4-4f0e-9a3b-ee90f75a8069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:28.887240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1344/2683] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:28.892041 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:28.957193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6a96c-6297-4f9a-a7d6-e91fffd2d324 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:28.962100 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:28.962785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:28.963068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:28.963340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:28.963966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:28.966059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:28.994816 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1340/2684] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:28.998933 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85f29-f2c4-4f0e-9a3b-ee90f75a8069 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:29.010753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85f29-f2c4-4f0e-9a3b-ee90f75a8069 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:29.033975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:29.072460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:29.073336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:29.073613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:29.073882 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:29.074544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:29.076468 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:29.099530 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1345/2685] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:28 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:29.103490 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:29.114903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865278c8-6c09-4380-91be-ee217db20c29 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:29.119852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:29.120552 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:29.120908 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:29.121253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:29.121968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:29.123687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:29.134650 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1341/2686] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:29.138790 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:29.149914 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d6c7-4d7d-49f4-a6ac-419047d4e144 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:29.154922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:29.155801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:29.155936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:29.156244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] PATH_INFO: `/v3/projects/2e8850a7009841e389cc77233e343843/users/df0624e7c6064bf3b7012c328ed6ca69/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:29.172685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8850a7009841e389cc77233e343843, user_id=df0624e7c6064bf3b7012c328ed6ca69, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:29.175397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:29.189246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1346/2687] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:29 2022] PUT /identity/v3/projects/2e8850a7009841e389cc77233e343843/users/df0624e7c6064bf3b7012c328ed6ca69/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:29.193856 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:29.208417 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3a717-7fc1-4910-af9e-69a15bb120dc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:29.275167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f204-1e70-45d7-a003-f9e2692848df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:29.275865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f204-1e70-45d7-a003-f9e2692848df admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:29.276153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f204-1e70-45d7-a003-f9e2692848df admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:29.276432 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f204-1e70-45d7-a003-f9e2692848df admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:29.277102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892f204-1e70-45d7-a003-f9e2692848df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:29.278774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892f204-1e70-45d7-a003-f9e2692848df admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:29.289470 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1342/2688] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:40:29.294643 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:29.306893 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a271c-4eea-406b-a019-9efa644b3ba3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:29.313003 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:29.314736 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:29.315019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:29.315295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] PATH_INFO: `/v3/projects/2e8850a7009841e389cc77233e343843/users/df0624e7c6064bf3b7012c328ed6ca69/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:29.317541 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8850a7009841e389cc77233e343843, user_id=df0624e7c6064bf3b7012c328ed6ca69, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:29.320642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:29.332557 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1347/2689] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:29 2022] PUT /identity/v3/projects/2e8850a7009841e389cc77233e343843/users/df0624e7c6064bf3b7012c328ed6ca69/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:29.343243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:29.343742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:29.344128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:29.376637 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] MFA Rules not processed for user `df0624e7c6064bf3b7012c328ed6ca69`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:29.378010 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:29.389059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:29.464806 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1343/2690] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:29.480569 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:29.482611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:29.555793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03aea9-4871-436e-b3a6-bb686819adf7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:29.560071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:29.560892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:29.561455 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:29.561885 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:29.575005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:29.576612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:29.587733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1348/2691] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:30.148665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:30.150368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:30.163218 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc2750-6c09-41fa-8f72-0059bfe6f3ba None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:30.166916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:30.167631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:30.167980 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:30.168323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:30.230115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:30.231810 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:30.242830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1344/2692] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:31.140597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:31.142112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:31.215837 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a687-04a1-465f-a2ca-b8a93a626e34 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:31.221214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:31.221891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:31.222189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:31.222551 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] PATH_INFO: `/v3/users/7c93b01a803d467f9b6a9d90962c3ffd` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:31.223688 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c93b01a803d467f9b6a9d90962c3ffd)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:31.225939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:31.249006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:31.277649 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c93b01a803d467f9b6a9d90962c3ffd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.284901 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c93b01a803d467f9b6a9d90962c3ffd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.285998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c93b01a803d467f9b6a9d90962c3ffd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.286728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c93b01a803d467f9b6a9d90962c3ffd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.293656 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c93b01a803d467f9b6a9d90962c3ffd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.313614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1349/2693] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:31 2022] DELETE /identity/v3/users/7c93b01a803d467f9b6a9d90962c3ffd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:31.497952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:31.513828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3aed-4bcc-4be6-88f1-e23981fa2486 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:31.577061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:31.577607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:31.577897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:31.578175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] PATH_INFO: `/v3/projects/dfe5e2a7cc8c4ac4bab1dab633f404e3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:31.579869 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe5e2a7cc8c4ac4bab1dab633f404e3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:31.581839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:31.627978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:31.630941 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe5e2a7cc8c4ac4bab1dab633f404e3', 'request_id': 'req-7f2fc6cc-cafd-4b94-bf36-524482a88180'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.637675 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe5e2a7cc8c4ac4bab1dab633f404e3', 'request_id': 'req-7f2fc6cc-cafd-4b94-bf36-524482a88180'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.646722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe5e2a7cc8c4ac4bab1dab633f404e3', 'request_id': 'req-7f2fc6cc-cafd-4b94-bf36-524482a88180'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.657920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] The token cache is being invalidate because project dfe5e2a7cc8c4ac4bab1dab633f404e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:31.658217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.658888 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.660635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1345/2694] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:31 2022] DELETE /identity/v3/projects/dfe5e2a7cc8c4ac4bab1dab633f404e3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:31.668609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:31.670049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:31.684628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5ff9-bf7d-4738-adb2-efbed052a48f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:31.747089 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:31.747758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:31.748034 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:31.748312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] PATH_INFO: `/v3/users/1aae412bf7ec4c39b728d9a37198d9fa` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:31.749440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aae412bf7ec4c39b728d9a37198d9fa)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:31.751505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:31.801539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aae412bf7ec4c39b728d9a37198d9fa'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.809869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aae412bf7ec4c39b728d9a37198d9fa'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.810548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aae412bf7ec4c39b728d9a37198d9fa'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.811188 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aae412bf7ec4c39b728d9a37198d9fa'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.820281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aae412bf7ec4c39b728d9a37198d9fa'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:31.840248 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1350/2695] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:31 2022] DELETE /identity/v3/users/1aae412bf7ec4c39b728d9a37198d9fa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:40:32.018521 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:32.020114 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:32.035165 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fc6cc-cafd-4b94-bf36-524482a88180 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:32.093968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:32.095163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:32.095448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:32.095728 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] PATH_INFO: `/v3/projects/41245bd4884e4961b1771defa30832e6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:32.096860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41245bd4884e4961b1771defa30832e6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:32.098811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:32.144134 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41245bd4884e4961b1771defa30832e6', 'request_id': 'req-f94850fe-3283-4b94-9674-3508d1eed23b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:32.150088 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41245bd4884e4961b1771defa30832e6', 'request_id': 'req-f94850fe-3283-4b94-9674-3508d1eed23b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:32.157920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41245bd4884e4961b1771defa30832e6', 'request_id': 'req-f94850fe-3283-4b94-9674-3508d1eed23b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:32.168283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] The token cache is being invalidate because project 41245bd4884e4961b1771defa30832e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:32.168570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:32.169189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:32.170680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1346/2696] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:32 2022] DELETE /identity/v3/projects/41245bd4884e4961b1771defa30832e6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:34.356211 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:34.357644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:34.378665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:34.417088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef515c7-5bb5-413d-845d-3e421549379d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:34.463721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd747310-2b6b-462a-8ca9-89715eaec49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:34.464328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd747310-2b6b-462a-8ca9-89715eaec49b service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:34.464612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd747310-2b6b-462a-8ca9-89715eaec49b service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:34.464892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd747310-2b6b-462a-8ca9-89715eaec49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:34.466666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bd747310-2b6b-462a-8ca9-89715eaec49b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:34.524222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd747310-2b6b-462a-8ca9-89715eaec49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:34.525633 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd747310-2b6b-462a-8ca9-89715eaec49b service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:34.534974 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1351/2697] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:36.596098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:36.597519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:36.661006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94850fe-3283-4b94-9674-3508d1eed23b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:36.665838 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:36.666526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:36.666809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:36.667085 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] PATH_INFO: `/v3/users/ec54b7a6621049428cd18331481491be` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:36.668328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec54b7a6621049428cd18331481491be)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:36.670248 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:36.675571 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:36.716928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec54b7a6621049428cd18331481491be'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:36.717572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec54b7a6621049428cd18331481491be'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:36.726486 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec54b7a6621049428cd18331481491be'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:36.733706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec54b7a6621049428cd18331481491be'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:36.749526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec54b7a6621049428cd18331481491be'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:36.755937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1347/2698] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:36 2022] DELETE /identity/v3/users/ec54b7a6621049428cd18331481491be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:36.760874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:36.761385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:36.761385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:36.781962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:36.783737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:36.843580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1352/2699] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:36.853745 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:36.855206 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:36.912562 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6e088-ce0d-4279-8050-d22ae2203b0b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:36.916318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:36.916923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:36.917204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:36.917482 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:36.926501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:36.927933 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:36.937370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1348/2700] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:37.219088 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:37.220516 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:37.234005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336082a-9888-4bb2-8bd7-27d858ebc020 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:37.238734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:37.239373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:37.239652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:37.239927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] PATH_INFO: `/v3/projects/234089f7b62e41e488f4d356ab6e2e97` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:37.241052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=234089f7b62e41e488f4d356ab6e2e97)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:37.242987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:37.269014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:37.291938 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234089f7b62e41e488f4d356ab6e2e97', 'request_id': 'req-4d465e97-338e-4d16-8f20-ec54db3ff84f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.297942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234089f7b62e41e488f4d356ab6e2e97', 'request_id': 'req-4d465e97-338e-4d16-8f20-ec54db3ff84f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.305069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234089f7b62e41e488f4d356ab6e2e97', 'request_id': 'req-4d465e97-338e-4d16-8f20-ec54db3ff84f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.315775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] The token cache is being invalidate because project 234089f7b62e41e488f4d356ab6e2e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:37.316067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.316684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.318145 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1353/2701] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:37 2022] DELETE /identity/v3/projects/234089f7b62e41e488f4d356ab6e2e97 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:37.322098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:37.332719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00187-9576-4c6f-bf89-b7d9498840f2 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:37.389542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:37.390195 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:37.390526 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:37.390805 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] PATH_INFO: `/v3/users/0e55bc10b49c412baace53189eb25f2e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:37.392584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e55bc10b49c412baace53189eb25f2e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:37.396468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:37.432960 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:37.448727 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e55bc10b49c412baace53189eb25f2e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.449389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e55bc10b49c412baace53189eb25f2e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.456927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e55bc10b49c412baace53189eb25f2e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.463878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e55bc10b49c412baace53189eb25f2e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.475905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e55bc10b49c412baace53189eb25f2e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.481842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1349/2702] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:37 2022] DELETE /identity/v3/users/0e55bc10b49c412baace53189eb25f2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:37.745483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:37.746962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:37.760861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465e97-338e-4d16-8f20-ec54db3ff84f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:37.817696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:37.818303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:37.818550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:37.818821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] PATH_INFO: `/v3/projects/3ca196d25f4d443d96c3974f34c9d49a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:37.819925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca196d25f4d443d96c3974f34c9d49a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:37.821805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:37.869284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca196d25f4d443d96c3974f34c9d49a', 'request_id': 'req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.875588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca196d25f4d443d96c3974f34c9d49a', 'request_id': 'req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.882773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca196d25f4d443d96c3974f34c9d49a', 'request_id': 'req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.893219 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] The token cache is being invalidate because project 3ca196d25f4d443d96c3974f34c9d49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:37.893506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.894124 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:37.895621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1354/2703] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:37 2022] DELETE /identity/v3/projects/3ca196d25f4d443d96c3974f34c9d49a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:37.899597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:37.901008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:37.914258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f263c-5ca3-40bd-999c-af06be8aaf14 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:37.969081 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:37.969699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:37.970547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:37.970821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] PATH_INFO: `/v3/users/df0624e7c6064bf3b7012c328ed6ca69` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:37.971946 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0624e7c6064bf3b7012c328ed6ca69)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:37.973862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.019262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0624e7c6064bf3b7012c328ed6ca69'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.019913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0624e7c6064bf3b7012c328ed6ca69'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.026865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0624e7c6064bf3b7012c328ed6ca69'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.034258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0624e7c6064bf3b7012c328ed6ca69'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.045870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4efad0b1-991a-4310-808c-4c50439b7033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0624e7c6064bf3b7012c328ed6ca69'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.052328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1350/2704] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:37 2022] DELETE /identity/v3/users/df0624e7c6064bf3b7012c328ed6ca69 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:38.315770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:38.317247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:38.331314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e60bcf-56f4-4f90-8d19-5d9038e899fb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:38.371978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:38.390564 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:38.391203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.391481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.392285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] PATH_INFO: `/v3/projects/2e8850a7009841e389cc77233e343843` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.393431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8850a7009841e389cc77233e343843)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:38.395379 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.440436 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8850a7009841e389cc77233e343843', 'request_id': 'req-9680373e-975d-43ab-8f32-5a871d82128e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.446890 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8850a7009841e389cc77233e343843', 'request_id': 'req-9680373e-975d-43ab-8f32-5a871d82128e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.455027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8850a7009841e389cc77233e343843', 'request_id': 'req-9680373e-975d-43ab-8f32-5a871d82128e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.465533 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] The token cache is being invalidate because project 2e8850a7009841e389cc77233e343843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:38.465826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.466477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9680373e-975d-43ab-8f32-5a871d82128e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:38.467928 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1355/2705] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:38 2022] DELETE /identity/v3/projects/2e8850a7009841e389cc77233e343843 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:38.474388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025f3d-17d6-44cf-84a9-758aeea7a18f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.474913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025f3d-17d6-44cf-84a9-758aeea7a18f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.475217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025f3d-17d6-44cf-84a9-758aeea7a18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.496196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-da025f3d-17d6-44cf-84a9-758aeea7a18f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:38.497413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-da025f3d-17d6-44cf-84a9-758aeea7a18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:38.518388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:38.558260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1351/2706] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:38.567053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debe30-6029-4ef1-a196-a8bbc2906fb9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.567339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debe30-6029-4ef1-a196-a8bbc2906fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.567614 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debe30-6029-4ef1-a196-a8bbc2906fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.587666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-52debe30-6029-4ef1-a196-a8bbc2906fb9 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:38.588804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-52debe30-6029-4ef1-a196-a8bbc2906fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:38.596552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1356/2707] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:38.600679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025f3d-17d6-44cf-84a9-758aeea7a18f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:38.610287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025f3d-17d6-44cf-84a9-758aeea7a18f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:38.614879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:38.615469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.615748 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.616022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.616663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:40:38.616964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:38.618597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.630498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1352/2708] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:40:38.634733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52debe30-6029-4ef1-a196-a8bbc2906fb9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:38.644479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52debe30-6029-4ef1-a196-a8bbc2906fb9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:38.649018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:38.649608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.649883 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.650153 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.650825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:38.652704 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.678577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1357/2709] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:38 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:38.682615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:38.692991 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f97b2-bdc3-4580-93d6-3744a1400b84 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:38.747534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:38.748161 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.748445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.748741 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.749340 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:38.751854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.773086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1353/2710] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:38 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:38.777149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:38.787494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40be7-7c4a-46f1-893f-4bf7df2523d5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:38.792053 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:38.792646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.792924 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.793195 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.793856 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:38.795512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.805147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1358/2711] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:38.809247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:38.819599 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db2f8-f55c-4c82-bafb-e576dce64b5a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:38.824474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bff3b-570f-45a1-8140-27ea0b03f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:38.825062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bff3b-570f-45a1-8140-27ea0b03f276 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.825343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bff3b-570f-45a1-8140-27ea0b03f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.825618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bff3b-570f-45a1-8140-27ea0b03f276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.826254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bff3b-570f-45a1-8140-27ea0b03f276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:38.827876 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bff3b-570f-45a1-8140-27ea0b03f276 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.839466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1354/2712] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:38.843224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:38.853268 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ea375-66f5-4634-88b5-777bdeb83bf6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:38.857895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:38.858577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.858860 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.859135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] PATH_INFO: `/v3/projects/e767fe68e31641d0a1f4ca56b08ec35c/users/d3fa646b4f0544ba898dad2bae439153/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.873888 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e767fe68e31641d0a1f4ca56b08ec35c, user_id=d3fa646b4f0544ba898dad2bae439153, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:38.877267 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:38.890479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1359/2713] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:38 2022] PUT /identity/v3/projects/e767fe68e31641d0a1f4ca56b08ec35c/users/d3fa646b4f0544ba898dad2bae439153/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:40:38.902495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bba2e-c3a4-44a9-930b-3bde6d522bdb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:38.902972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bba2e-c3a4-44a9-930b-3bde6d522bdb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:38.903078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bba2e-c3a4-44a9-930b-3bde6d522bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:38.930096 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d09bba2e-c3a4-44a9-930b-3bde6d522bdb None None] MFA Rules not processed for user `d3fa646b4f0544ba898dad2bae439153`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:38.931346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d09bba2e-c3a4-44a9-930b-3bde6d522bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:38.993075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1355/2714] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:38.997502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.058477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8e8d8-d0fb-442e-9be5-cd7d6b716d7f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.063129 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.064325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.064608 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.064884 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.065520 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.067453 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.081897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:39.095335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1360/2715] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:38 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:39.099316 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bba2e-c3a4-44a9-930b-3bde6d522bdb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.109949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bba2e-c3a4-44a9-930b-3bde6d522bdb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.128894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:39.166811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.167413 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.167692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.167966 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.168602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.170533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.194030 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1356/2716] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:39 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:39.195758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.206049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c7209-7dda-4b9c-bb8c-ea8c3d97c37e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.210678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.211270 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.211576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.211846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.212483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.214062 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.225604 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1361/2717] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:39.229466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.239731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4ddc-87fe-451e-92f9-945de71afefc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.244266 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.244900 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.245179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.245450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] PATH_INFO: `/v3/projects/522be1df8dc040f3b424aeb85347d809/users/893801712589468cbd9c4f604a26a7ca/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.260734 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522be1df8dc040f3b424aeb85347d809, user_id=893801712589468cbd9c4f604a26a7ca, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.263625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.276818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1357/2718] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:39 2022] PUT /identity/v3/projects/522be1df8dc040f3b424aeb85347d809/users/893801712589468cbd9c4f604a26a7ca/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:39.280781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.291092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4288e9-3f48-447b-8d57-85acf710dcad admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.345953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70be16-5230-4de1-b327-92fd6704a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.346509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70be16-5230-4de1-b327-92fd6704a871 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.346799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70be16-5230-4de1-b327-92fd6704a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.347051 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70be16-5230-4de1-b327-92fd6704a871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.347673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70be16-5230-4de1-b327-92fd6704a871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.349244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70be16-5230-4de1-b327-92fd6704a871 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.358725 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1362/2719] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:39.363305 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.374678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2d51-6407-4dcf-854d-07b7a4a5d680 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.379361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.380006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.380285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.380558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] PATH_INFO: `/v3/projects/522be1df8dc040f3b424aeb85347d809/users/893801712589468cbd9c4f604a26a7ca/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.382549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=522be1df8dc040f3b424aeb85347d809, user_id=893801712589468cbd9c4f604a26a7ca, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.385177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.395508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1358/2720] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:39 2022] PUT /identity/v3/projects/522be1df8dc040f3b424aeb85347d809/users/893801712589468cbd9c4f604a26a7ca/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:39.405685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b724501-3f31-4c2c-b9e1-dd8c490c630b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.405988 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b724501-3f31-4c2c-b9e1-dd8c490c630b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.406261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b724501-3f31-4c2c-b9e1-dd8c490c630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.433872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8b724501-3f31-4c2c-b9e1-dd8c490c630b None None] MFA Rules not processed for user `893801712589468cbd9c4f604a26a7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:39.435086 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b724501-3f31-4c2c-b9e1-dd8c490c630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:39.505290 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1363/2721] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:39.516270 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.518042 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:39.574999 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d705d4b-2607-4e57-9e45-5b513a663dee admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.579170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.579781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.580062 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.580336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.589594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.591054 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.601189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1359/2722] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:39.703817 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b724501-3f31-4c2c-b9e1-dd8c490c630b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:39.713959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b724501-3f31-4c2c-b9e1-dd8c490c630b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:39.717817 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17eeb-57ca-467b-ac44-048dd77a67c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:39.718456 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17eeb-57ca-467b-ac44-048dd77a67c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:39.718735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17eeb-57ca-467b-ac44-048dd77a67c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:39.719005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17eeb-57ca-467b-ac44-048dd77a67c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:39.774066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17eeb-57ca-467b-ac44-048dd77a67c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:39.775531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17eeb-57ca-467b-ac44-048dd77a67c0 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:39.784775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1364/2723] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:42.385771 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:42.446279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520094-e49c-41f2-afdf-76e9e141b38f service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:42.451076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:42.451686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:42.451968 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:42.452237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] PATH_INFO: `/v3/users/d3fa646b4f0544ba898dad2bae439153` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:42.453369 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fa646b4f0544ba898dad2bae439153)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:42.455917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:42.475802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:42.501228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fa646b4f0544ba898dad2bae439153'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:42.502438 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fa646b4f0544ba898dad2bae439153'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:42.509515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fa646b4f0544ba898dad2bae439153'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:42.516568 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fa646b4f0544ba898dad2bae439153'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:42.528852 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fa646b4f0544ba898dad2bae439153'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:42.534658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1360/2724] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:42 2022] DELETE /identity/v3/users/d3fa646b4f0544ba898dad2bae439153 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:42.539081 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:42.539561 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:42.539665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:42.546638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:42.560491 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:42.561696 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:42.622438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1365/2725] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:40:42.631952 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:42.633436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:42.693533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accdeea-e417-4021-b058-200563ec6f17 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:42.697124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:42.697986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:42.698262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:42.698561 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:42.707324 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:42.708746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:42.717942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1361/2726] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:42.979370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:42.980819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:42.993504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc04b-5a74-4b5d-8eae-72bb7c7b515a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:42.998365 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:42.999064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:42.999344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:42.999615 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] PATH_INFO: `/v3/projects/e767fe68e31641d0a1f4ca56b08ec35c` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.000735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e767fe68e31641d0a1f4ca56b08ec35c)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:43.004227 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:43.051462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e767fe68e31641d0a1f4ca56b08ec35c', 'request_id': 'req-4223c292-1ea0-42f6-97b3-a150c23c5bbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.058038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e767fe68e31641d0a1f4ca56b08ec35c', 'request_id': 'req-4223c292-1ea0-42f6-97b3-a150c23c5bbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.065324 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e767fe68e31641d0a1f4ca56b08ec35c', 'request_id': 'req-4223c292-1ea0-42f6-97b3-a150c23c5bbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.076005 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] The token cache is being invalidate because project e767fe68e31641d0a1f4ca56b08ec35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:43.076313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.076930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.078428 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1366/2727] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:42 2022] DELETE /identity/v3/projects/e767fe68e31641d0a1f4ca56b08ec35c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:43.083212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:43.093378 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5378794-7f5d-4146-a710-5f1d8e167315 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:43.152214 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:43.153162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.154220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.154220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] PATH_INFO: `/v3/users/893801712589468cbd9c4f604a26a7ca` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.155696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=893801712589468cbd9c4f604a26a7ca)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:43.157655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:43.201646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:43.207277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893801712589468cbd9c4f604a26a7ca'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.208213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893801712589468cbd9c4f604a26a7ca'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.215914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893801712589468cbd9c4f604a26a7ca'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.223288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893801712589468cbd9c4f604a26a7ca'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.234720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0a97bfb-7abc-44c2-b40d-adb0cc440a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893801712589468cbd9c4f604a26a7ca'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.241159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1362/2728] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:43 2022] DELETE /identity/v3/users/893801712589468cbd9c4f604a26a7ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:40:43.516157 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:43.518166 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:43.531985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223c292-1ea0-42f6-97b3-a150c23c5bbe admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:43.594849 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:43.595477 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.596202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.596479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] PATH_INFO: `/v3/projects/522be1df8dc040f3b424aeb85347d809` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.597584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=522be1df8dc040f3b424aeb85347d809)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:43.599525 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:43.629358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:43.648573 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522be1df8dc040f3b424aeb85347d809', 'request_id': 'req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.654716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522be1df8dc040f3b424aeb85347d809', 'request_id': 'req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.663461 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522be1df8dc040f3b424aeb85347d809', 'request_id': 'req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.674238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] The token cache is being invalidate because project 522be1df8dc040f3b424aeb85347d809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:43.674559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.675194 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f00fde4b-95e4-4c63-b87a-ad3c9dba6fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:43.676965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1367/2729] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:43 2022] DELETE /identity/v3/projects/522be1df8dc040f3b424aeb85347d809 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:43.681767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473187f-d61b-451e-8c59-03432b1d0ebc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.682232 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473187f-d61b-451e-8c59-03432b1d0ebc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.682389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473187f-d61b-451e-8c59-03432b1d0ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.701729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0473187f-d61b-451e-8c59-03432b1d0ebc None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:43.702995 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0473187f-d61b-451e-8c59-03432b1d0ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:43.762823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1363/2730] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:43.772042 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f8064-cdf7-48f0-8ca6-388c77d7a62f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.772327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f8064-cdf7-48f0-8ca6-388c77d7a62f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.772603 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f8064-cdf7-48f0-8ca6-388c77d7a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.791839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fa8f8064-cdf7-48f0-8ca6-388c77d7a62f None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:43.793039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fa8f8064-cdf7-48f0-8ca6-388c77d7a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:43.800942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1368/2731] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:43.805122 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473187f-d61b-451e-8c59-03432b1d0ebc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:43.815446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473187f-d61b-451e-8c59-03432b1d0ebc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:43.820102 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:43.820699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.820981 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.821261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.821910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:40:43.822217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:43.824115 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:43.836360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1364/2732] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:40:43.840313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f8064-cdf7-48f0-8ca6-388c77d7a62f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:43.849537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f8064-cdf7-48f0-8ca6-388c77d7a62f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:43.854134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:43.854771 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.855047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.855319 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.855944 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:43.857842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:43.884117 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1369/2733] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:43 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:43.888131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:43.898610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f9159-5051-4bc6-a4ab-cf3042722c0a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:43.953818 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:43.954778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.955618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.955891 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:43.956508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:43.958439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:43.979255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1365/2734] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:43 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:40:43.983507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:43.993897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2c4b-ab40-4408-b4b5-b10070e70632 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:43.998502 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:43.999096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:43.999375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:43.999645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.000285 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.002400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.012130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1370/2735] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:44.016105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.026903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0de1d-d0a7-4b34-ba60-34774011cee2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.031749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70465d-fba8-4174-be9b-4ca3a64ed237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.032333 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70465d-fba8-4174-be9b-4ca3a64ed237 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.032614 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70465d-fba8-4174-be9b-4ca3a64ed237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.032887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70465d-fba8-4174-be9b-4ca3a64ed237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.033557 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70465d-fba8-4174-be9b-4ca3a64ed237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.035170 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70465d-fba8-4174-be9b-4ca3a64ed237 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.045461 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1366/2736] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:40:44.049416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.059304 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db68b7-16f9-4dff-965f-4a4e81c735c7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.063941 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.065090 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.065368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.065639 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] PATH_INFO: `/v3/projects/3f619e883d064c36a018cc872c61cd72/users/f58cc5062c8647e3a9785aa0e60ffbbe/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.081753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f619e883d064c36a018cc872c61cd72, user_id=f58cc5062c8647e3a9785aa0e60ffbbe, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.084416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.096660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1371/2737] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:44 2022] PUT /identity/v3/projects/3f619e883d064c36a018cc872c61cd72/users/f58cc5062c8647e3a9785aa0e60ffbbe/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:40:44.106793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c15a-8480-4850-9a70-b3e6ed434ac3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.107011 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c15a-8480-4850-9a70-b3e6ed434ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.107286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c15a-8480-4850-9a70-b3e6ed434ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.135454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-86b4c15a-8480-4850-9a70-b3e6ed434ac3 None None] MFA Rules not processed for user `f58cc5062c8647e3a9785aa0e60ffbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:44.136680 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86b4c15a-8480-4850-9a70-b3e6ed434ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:44.148299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:44.201507 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1367/2738] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:44.205925 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.266950 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ecbbb-f6e8-45d9-b861-1758728a86fd admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.271995 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.272613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.272903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.273171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.273833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.276401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.303271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1372/2739] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:44 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:44.307392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c15a-8480-4850-9a70-b3e6ed434ac3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.318666 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c15a-8480-4850-9a70-b3e6ed434ac3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.375851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.376474 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.377382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.377671 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.378289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.380231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.401188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1368/2740] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:44 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:40:44.404958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.415251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f2d6-7226-49c4-a025-cf43640c7052 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.419819 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.420410 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.420686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.420957 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.421594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.423203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.433894 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1373/2741] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:44.437636 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.448260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049d96-64ed-4e54-b3a4-18076cee3f64 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.452855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158ad3c-cd08-4907-8b6c-7af1115bff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.453439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ad3c-cd08-4907-8b6c-7af1115bff48 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.453716 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ad3c-cd08-4907-8b6c-7af1115bff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.453988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ad3c-cd08-4907-8b6c-7af1115bff48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.454657 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158ad3c-cd08-4907-8b6c-7af1115bff48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.456274 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158ad3c-cd08-4907-8b6c-7af1115bff48 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.465921 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1369/2742] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:40:44.469735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.480288 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21f7d6-c366-4d5d-9b54-f9fab0015e89 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.484998 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.485665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.485971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.486291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] PATH_INFO: `/v3/projects/790ea39e613b4e8f80edef4e69f9e12a/users/713ee7b330fd46f2bcba53785b72cec7/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.500945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790ea39e613b4e8f80edef4e69f9e12a, user_id=713ee7b330fd46f2bcba53785b72cec7, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.503600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.515616 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1374/2743] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:44 2022] PUT /identity/v3/projects/790ea39e613b4e8f80edef4e69f9e12a/users/713ee7b330fd46f2bcba53785b72cec7/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:44.525609 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b88076-594c-4bd0-9a90-2b69440f6000 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.525923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b88076-594c-4bd0-9a90-2b69440f6000 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.526199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b88076-594c-4bd0-9a90-2b69440f6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.554186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-31b88076-594c-4bd0-9a90-2b69440f6000 None None] MFA Rules not processed for user `713ee7b330fd46f2bcba53785b72cec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:44.555496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-31b88076-594c-4bd0-9a90-2b69440f6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:44.618823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1370/2744] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:40:44.623315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.627871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:44.686937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca53973-8b9d-4829-ad73-d29655884d72 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.691842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.692554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.692845 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.693168 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.693793 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.695908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.722148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1375/2745] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:44 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:44.726254 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b88076-594c-4bd0-9a90-2b69440f6000 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.737830 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b88076-594c-4bd0-9a90-2b69440f6000 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.755538 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:44.795162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.795767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.796046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.796317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.796958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.799481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.820162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1371/2746] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:44 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:40:44.825310 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.840284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba019c39-1107-40d9-9be3-4db06e378da0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.846912 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.847517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.847795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.848068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:44.848706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:44.850298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:44.861788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1376/2747] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:44.865929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:44.875983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8bf1-1e2b-427e-885a-938fbf02dd81 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:44.880658 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:44.881243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:44.881523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:44.881797 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] PATH_INFO: `/v3/projects/a770c19090524fff9899727b8dc4d7ac/users/73a58374203d4e7aa0957f61b059c373/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:45.018224 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a770c19090524fff9899727b8dc4d7ac, user_id=73a58374203d4e7aa0957f61b059c373, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:45.020953 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:45.034488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1372/2748] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:44 2022] PUT /identity/v3/projects/a770c19090524fff9899727b8dc4d7ac/users/73a58374203d4e7aa0957f61b059c373/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:45.038714 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:45.048579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72a338-3fe5-41c9-bdc9-9788dac34318 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:45.104932 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48713d69-42d2-4047-b62d-e757e41c32c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:45.105552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713d69-42d2-4047-b62d-e757e41c32c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:45.105834 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713d69-42d2-4047-b62d-e757e41c32c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:45.106109 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713d69-42d2-4047-b62d-e757e41c32c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:45.106777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48713d69-42d2-4047-b62d-e757e41c32c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:45.108404 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48713d69-42d2-4047-b62d-e757e41c32c1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:45.118300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1377/2749] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:45.122485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:45.132972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f394fe-0865-414f-81ac-5907369b7423 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:45.137604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:45.138256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:45.138567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:45.138861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] PATH_INFO: `/v3/projects/a770c19090524fff9899727b8dc4d7ac/users/73a58374203d4e7aa0957f61b059c373/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:45.141549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a770c19090524fff9899727b8dc4d7ac, user_id=73a58374203d4e7aa0957f61b059c373, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:45.144709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:45.154918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1373/2750] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:45 2022] PUT /identity/v3/projects/a770c19090524fff9899727b8dc4d7ac/users/73a58374203d4e7aa0957f61b059c373/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:45.224640 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:45.224970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:45.225251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:45.253952 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] MFA Rules not processed for user `73a58374203d4e7aa0957f61b059c373`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:45.255224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:45.319351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:45.325596 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1378/2751] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:45.337078 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:45.338910 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:45.397554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb58e9a-0582-4d94-8d5a-62874a57fa49 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:45.401093 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:45.401699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:45.401983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:45.402253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:45.459001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:45.460433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:45.469541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1374/2752] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:46.982221 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:46.983710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:47.004759 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd893-8e11-4a49-94dd-1e0978f20a70 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:47.008366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:47.008965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:47.009246 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:47.009519 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:47.070761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:47.072103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:47.081394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1379/2753] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:47.598615 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:47.607685 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b538d0-6e10-4617-ae80-39a78507fb84 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:47.611246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf4e88-04fe-476d-a8a8-c499411c4d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:47.611841 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4e88-04fe-476d-a8a8-c499411c4d80 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:47.612137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4e88-04fe-476d-a8a8-c499411c4d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:47.612395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4e88-04fe-476d-a8a8-c499411c4d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:47.621130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4e88-04fe-476d-a8a8-c499411c4d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:47.622567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4e88-04fe-476d-a8a8-c499411c4d80 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:47.632302 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1375/2754] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:51.482685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:51.543926 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b2e2-62de-4494-b6e9-8dfebfcb3cc6 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:51.548429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:51.549054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:51.549337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:51.549620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] PATH_INFO: `/v3/users/f58cc5062c8647e3a9785aa0e60ffbbe` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:51.550773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58cc5062c8647e3a9785aa0e60ffbbe)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:51.552701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:51.600871 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58cc5062c8647e3a9785aa0e60ffbbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:51.608362 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58cc5062c8647e3a9785aa0e60ffbbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:51.609092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58cc5062c8647e3a9785aa0e60ffbbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:51.609710 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58cc5062c8647e3a9785aa0e60ffbbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:51.617162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58cc5062c8647e3a9785aa0e60ffbbe'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:51.634795 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1380/2755] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:51 2022] DELETE /identity/v3/users/f58cc5062c8647e3a9785aa0e60ffbbe => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:51.639228 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:51.639718 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:51.639821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:51.658231 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:51.659483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:51.668558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:51.726540 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1376/2756] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:40:51.737287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:51.738867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:51.758788 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:51.801500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e5df-fee0-4f54-9fc3-a244ac471eab admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:51.805045 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:51.805652 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:51.805934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:51.806217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:51.815965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:51.817400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:51.827047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1381/2757] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:40:52.096706 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:52.098212 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:52.113430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d067-744c-4fd5-98c8-f464e82f86c8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:52.119394 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:52.119914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:52.120192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:52.120574 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] PATH_INFO: `/v3/projects/3f619e883d064c36a018cc872c61cd72` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:52.121607 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f619e883d064c36a018cc872c61cd72)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:52.123566 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:52.170885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f619e883d064c36a018cc872c61cd72', 'request_id': 'req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.177498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f619e883d064c36a018cc872c61cd72', 'request_id': 'req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.184765 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f619e883d064c36a018cc872c61cd72', 'request_id': 'req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.195190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] The token cache is being invalidate because project 3f619e883d064c36a018cc872c61cd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:52.195478 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.196119 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.197570 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1377/2758] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:52 2022] DELETE /identity/v3/projects/3f619e883d064c36a018cc872c61cd72 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:52.201763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:52.211258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd2cc-9cae-42d2-ad66-ed5a6292b0fb service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:52.267218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:52.267922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:52.268220 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:52.268494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] PATH_INFO: `/v3/users/713ee7b330fd46f2bcba53785b72cec7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:52.269620 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=713ee7b330fd46f2bcba53785b72cec7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:52.271567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:52.316605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713ee7b330fd46f2bcba53785b72cec7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.324099 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713ee7b330fd46f2bcba53785b72cec7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.324727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713ee7b330fd46f2bcba53785b72cec7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.325348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713ee7b330fd46f2bcba53785b72cec7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.332378 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713ee7b330fd46f2bcba53785b72cec7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.349737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1382/2759] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:52 2022] DELETE /identity/v3/users/713ee7b330fd46f2bcba53785b72cec7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:52.629283 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:52.631036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:52.652923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1315a-a3f8-4bb7-ba04-d643b2c8ae72 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:52.716455 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:52.717095 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:52.717376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:52.717676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] PATH_INFO: `/v3/projects/790ea39e613b4e8f80edef4e69f9e12a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:52.718832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=790ea39e613b4e8f80edef4e69f9e12a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:52.721896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:52.762973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:52.771166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790ea39e613b4e8f80edef4e69f9e12a', 'request_id': 'req-54473e47-9400-4533-8f9e-11a1a4b6bfaf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.777696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790ea39e613b4e8f80edef4e69f9e12a', 'request_id': 'req-54473e47-9400-4533-8f9e-11a1a4b6bfaf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.785463 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790ea39e613b4e8f80edef4e69f9e12a', 'request_id': 'req-54473e47-9400-4533-8f9e-11a1a4b6bfaf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.795901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] The token cache is being invalidate because project 790ea39e613b4e8f80edef4e69f9e12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:52.796193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.796813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.798281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1378/2760] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:52 2022] DELETE /identity/v3/projects/790ea39e613b4e8f80edef4e69f9e12a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:52.802377 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:52.803844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:52.816818 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9d2be-d65c-4c17-ba26-16959c75ac4b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:52.849921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:52.873366 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:52.873927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:52.874226 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:52.874539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] PATH_INFO: `/v3/users/73a58374203d4e7aa0957f61b059c373` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:52.875646 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a58374203d4e7aa0957f61b059c373)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:52.878130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:52.922567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a58374203d4e7aa0957f61b059c373'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.929429 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a58374203d4e7aa0957f61b059c373'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.930105 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a58374203d4e7aa0957f61b059c373'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.930746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a58374203d4e7aa0957f61b059c373'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.937708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5b5cb57f-5bf1-4e72-bf53-2d85899c3bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a58374203d4e7aa0957f61b059c373'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:52.955312 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1383/2761] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:40:52 2022] DELETE /identity/v3/users/73a58374203d4e7aa0957f61b059c373 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:53.229674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.231196 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:53.243778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473e47-9400-4533-8f9e-11a1a4b6bfaf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.300918 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.301551 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.301833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.302106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] PATH_INFO: `/v3/projects/a770c19090524fff9899727b8dc4d7ac` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.303258 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a770c19090524fff9899727b8dc4d7ac)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.305157 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:53.352189 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a770c19090524fff9899727b8dc4d7ac', 'request_id': 'req-2b49e2cf-369d-4e91-b0c4-10e31afe7414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:53.358091 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a770c19090524fff9899727b8dc4d7ac', 'request_id': 'req-2b49e2cf-369d-4e91-b0c4-10e31afe7414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:53.365935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a770c19090524fff9899727b8dc4d7ac', 'request_id': 'req-2b49e2cf-369d-4e91-b0c4-10e31afe7414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:53.376110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] The token cache is being invalidate because project a770c19090524fff9899727b8dc4d7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:40:53.376396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:53.377598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2b49e2cf-369d-4e91-b0c4-10e31afe7414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:40:53.379108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1379/2762] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:40:53 2022] DELETE /identity/v3/projects/a770c19090524fff9899727b8dc4d7ac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:53.384052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb0c8-5350-4eb0-bc49-28f3417d4be9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.384381 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb0c8-5350-4eb0-bc49-28f3417d4be9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.384660 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb0c8-5350-4eb0-bc49-28f3417d4be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.405333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-621fb0c8-5350-4eb0-bc49-28f3417d4be9 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:53.406630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-621fb0c8-5350-4eb0-bc49-28f3417d4be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:53.467984 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1384/2763] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:53.476027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff607-58ba-45f1-8e4a-2a8d9fc13fe2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.476309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff607-58ba-45f1-8e4a-2a8d9fc13fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.476578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff607-58ba-45f1-8e4a-2a8d9fc13fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.496429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4c6ff607-58ba-45f1-8e4a-2a8d9fc13fe2 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:53.497635 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4c6ff607-58ba-45f1-8e4a-2a8d9fc13fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:53.505928 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1380/2764] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:40:53.510028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb0c8-5350-4eb0-bc49-28f3417d4be9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.520385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb0c8-5350-4eb0-bc49-28f3417d4be9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.525472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.526079 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.526374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.526686 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.527325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:40:53.527625 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.529233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:53.541514 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1385/2765] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:40:53.545696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff607-58ba-45f1-8e4a-2a8d9fc13fe2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.554902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff607-58ba-45f1-8e4a-2a8d9fc13fe2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.559613 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.560236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.560515 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.560788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.561412 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.563337 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:53.591327 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1381/2766] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:40:53 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:53.596078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.606173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ebf-9e28-45f8-b1ab-bfbfea6f4db6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.647567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:53.663360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.664065 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.664266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.664582 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.665275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.667327 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:53.687716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1386/2767] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:40:53 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:40:53.692370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.703204 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf524-5f12-4d22-be7b-af11d7bedaba admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.708374 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.708961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.709238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.709508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.710142 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.711772 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:53.721742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1382/2768] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:53.725471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.735589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6803497-426c-47bb-8f54-ff6f8ef63b3e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.740786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2bf00-f2ae-4a00-975a-71e7639be7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.741373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2bf00-f2ae-4a00-975a-71e7639be7cb admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.741650 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2bf00-f2ae-4a00-975a-71e7639be7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.741920 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2bf00-f2ae-4a00-975a-71e7639be7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.742590 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2bf00-f2ae-4a00-975a-71e7639be7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.744170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2bf00-f2ae-4a00-975a-71e7639be7cb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:53.759361 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1387/2769] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:40:53.760763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.771269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50630393-9f0a-439a-8752-aa4c13baefd4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.775860 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.776496 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.776776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.777047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] PATH_INFO: `/v3/projects/7199dae6bcf94dbe9951cc6832c9d908/users/6ec4e694106e4644baf1a7b0a5c2c9bf/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.791162 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7199dae6bcf94dbe9951cc6832c9d908, user_id=6ec4e694106e4644baf1a7b0a5c2c9bf, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.793796 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:53.796761 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:53.808186 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1383/2770] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:40:53 2022] PUT /identity/v3/projects/7199dae6bcf94dbe9951cc6832c9d908/users/6ec4e694106e4644baf1a7b0a5c2c9bf/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:40:53.820027 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.820522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.820629 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.848807 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] MFA Rules not processed for user `6ec4e694106e4644baf1a7b0a5c2c9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:40:53.850036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:53.912610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1388/2771] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:40:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:40:53.924251 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:40:53.925957 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:40:53.981592 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875279f-f7df-4d70-b8a9-74acfad16ddf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:40:53.985198 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:40:53.985793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:40:53.986070 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:40:53.986931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:40:53.994942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:40:53.996351 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:40:54.005596 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1384/2772] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:40:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:03.909761 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:04.001060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=28 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:04.464711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:04.466159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:04.523801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b403-5772-426c-8ef8-bf57b006b30f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:04.527280 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d77d3-dc16-4e54-8b0f-dda9c406a5ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:04.527881 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d77d3-dc16-4e54-8b0f-dda9c406a5ec service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:04.528163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d77d3-dc16-4e54-8b0f-dda9c406a5ec service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:04.528444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d77d3-dc16-4e54-8b0f-dda9c406a5ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:04.530148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d04d77d3-dc16-4e54-8b0f-dda9c406a5ec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:04.601597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d77d3-dc16-4e54-8b0f-dda9c406a5ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:04.603084 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d77d3-dc16-4e54-8b0f-dda9c406a5ec service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:04.614500 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1389/2773] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:04.789217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:04.790559 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:04.850866 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74fdf4-9535-49c6-b0d9-67e8af02309d service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:04.855243 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:04.855882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:04.856164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:04.856440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:04.858179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:04.872107 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:04.873531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:04.885164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1385/2774] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:14.609287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=54 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:14.879695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=26 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:18.660380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4db17f-1aac-4774-8a4a-50f0ca4562e0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:18.660863 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4db17f-1aac-4774-8a4a-50f0ca4562e0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:18.660958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4db17f-1aac-4774-8a4a-50f0ca4562e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:18.681292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6b4db17f-1aac-4774-8a4a-50f0ca4562e0 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:18.682147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6b4db17f-1aac-4774-8a4a-50f0ca4562e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:18.738167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1390/2775] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:41:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:18.750306 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:18.751740 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:18.824897 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ed3b8-f8c2-4367-b4ea-d22d83e9b7c3 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:18.829988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65e0f1-abf7-4489-a415-d2939dc6c2a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:18.830611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65e0f1-abf7-4489-a415-d2939dc6c2a9 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:18.830896 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65e0f1-abf7-4489-a415-d2939dc6c2a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:18.831174 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65e0f1-abf7-4489-a415-d2939dc6c2a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:18.840448 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65e0f1-abf7-4489-a415-d2939dc6c2a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:18.842074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65e0f1-abf7-4489-a415-d2939dc6c2a9 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:18.857421 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1386/2776] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:41:24.005754 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4db17f-1aac-4774-8a4a-50f0ca4562e0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:24.077684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4db17f-1aac-4774-8a4a-50f0ca4562e0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:24.082329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:24.082994 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:24.083279 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:24.083559 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] PATH_INFO: `/v3/users/6ec4e694106e4644baf1a7b0a5c2c9bf` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:24.085294 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec4e694106e4644baf1a7b0a5c2c9bf)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:24.087278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:24.155869 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec4e694106e4644baf1a7b0a5c2c9bf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.164189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec4e694106e4644baf1a7b0a5c2c9bf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.164872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec4e694106e4644baf1a7b0a5c2c9bf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.165584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec4e694106e4644baf1a7b0a5c2c9bf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.174490 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec4e694106e4644baf1a7b0a5c2c9bf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.195483 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1391/2777] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:41:24 2022] DELETE /identity/v3/users/6ec4e694106e4644baf1a7b0a5c2c9bf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:41:24.200451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54466939-8a65-45ec-a81a-40694d92122e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:24.201022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54466939-8a65-45ec-a81a-40694d92122e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:24.201022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54466939-8a65-45ec-a81a-40694d92122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:24.222364 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-54466939-8a65-45ec-a81a-40694d92122e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:24.223563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-54466939-8a65-45ec-a81a-40694d92122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:24.321949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1387/2778] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:24.332626 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:24.334830 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:24.366709 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:24.409063 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b7aca-bb2d-494d-8e6b-141105dc553e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:24.413406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95954ba9-2b9e-4f98-8f15-160e663d7f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:24.414049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95954ba9-2b9e-4f98-8f15-160e663d7f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:24.414459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95954ba9-2b9e-4f98-8f15-160e663d7f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:24.414689 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95954ba9-2b9e-4f98-8f15-160e663d7f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:24.428985 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95954ba9-2b9e-4f98-8f15-160e663d7f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:24.430479 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95954ba9-2b9e-4f98-8f15-160e663d7f74 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:24.448556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1392/2779] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:24.785489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54466939-8a65-45ec-a81a-40694d92122e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:24.787239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-54466939-8a65-45ec-a81a-40694d92122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:24.805025 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54466939-8a65-45ec-a81a-40694d92122e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:24.826281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:24.827128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:24.827430 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:24.827695 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] PATH_INFO: `/v3/projects/7199dae6bcf94dbe9951cc6832c9d908` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:24.828862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7199dae6bcf94dbe9951cc6832c9d908)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:24.830813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:24.883207 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7199dae6bcf94dbe9951cc6832c9d908', 'request_id': 'req-afe75d60-ae50-46b4-9142-0dfe8a001a68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.890019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7199dae6bcf94dbe9951cc6832c9d908', 'request_id': 'req-afe75d60-ae50-46b4-9142-0dfe8a001a68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.898826 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7199dae6bcf94dbe9951cc6832c9d908', 'request_id': 'req-afe75d60-ae50-46b4-9142-0dfe8a001a68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.911227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] The token cache is being invalidate because project 7199dae6bcf94dbe9951cc6832c9d908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:41:24.911779 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.913130 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-afe75d60-ae50-46b4-9142-0dfe8a001a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:41:24.915160 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1388/2780] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:41:24 2022] DELETE /identity/v3/projects/7199dae6bcf94dbe9951cc6832c9d908 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:41:24.920044 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24018e0-4ca9-40fb-956c-55d907c3c529 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:24.920333 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24018e0-4ca9-40fb-956c-55d907c3c529 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:24.920611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24018e0-4ca9-40fb-956c-55d907c3c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:24.942763 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b24018e0-4ca9-40fb-956c-55d907c3c529 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:24.944298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b24018e0-4ca9-40fb-956c-55d907c3c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:25.023302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1393/2781] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:25.031846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb74a-1b3d-4a3c-b13a-ee5e6f8aaa4e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.031846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb74a-1b3d-4a3c-b13a-ee5e6f8aaa4e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.032131 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb74a-1b3d-4a3c-b13a-ee5e6f8aaa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.055949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4ecfb74a-1b3d-4a3c-b13a-ee5e6f8aaa4e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:25.057185 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4ecfb74a-1b3d-4a3c-b13a-ee5e6f8aaa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:25.066546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1389/2782] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:25.069695 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24018e0-4ca9-40fb-956c-55d907c3c529 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:25.084101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24018e0-4ca9-40fb-956c-55d907c3c529 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:25.092401 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:25.093438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.093721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.093997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.094678 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:41:25.094987 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:25.096598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:25.113344 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1394/2783] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:41:25.118252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb74a-1b3d-4a3c-b13a-ee5e6f8aaa4e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:25.136047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb74a-1b3d-4a3c-b13a-ee5e6f8aaa4e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:25.141446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:25.142141 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.142497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.142776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.143472 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:25.145308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:25.150598 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:25.186234 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1390/2784] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:41:25 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:41:25.187545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:25.199753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85b53-6bc2-4763-b123-6b11fbd37728 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:25.296101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:25.296722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.297001 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.297269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.297905 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:25.300004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:25.328601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1395/2785] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:41:25 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:41:25.332704 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:25.344710 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87644-52fa-4fb1-9ba5-af9de85bad36 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:25.349871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:25.350535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.350920 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.351209 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.352012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:25.353610 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:25.369156 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1391/2786] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:41:25.370956 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:25.388859 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487236f-b9cc-48ae-bce3-9b13260fb2e8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:25.393719 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f064c-1701-42a7-a9bd-91425bc8d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:25.394421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f064c-1701-42a7-a9bd-91425bc8d48a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.394767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f064c-1701-42a7-a9bd-91425bc8d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.395123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f064c-1701-42a7-a9bd-91425bc8d48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.395833 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f064c-1701-42a7-a9bd-91425bc8d48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:25.397570 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f064c-1701-42a7-a9bd-91425bc8d48a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:25.414717 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1396/2787] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:41:25.416788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:25.428449 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b212-a31f-450c-a458-c890c7768181 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:25.433534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:25.434278 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.434597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.434929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] PATH_INFO: `/v3/projects/19ab8049abae422a9447bf652c3e3e1f/users/a3fa584a87ac49d48ea129170ead8b3c/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.454959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ab8049abae422a9447bf652c3e3e1f, user_id=a3fa584a87ac49d48ea129170ead8b3c, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:25.458285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:25.481395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1392/2788] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:41:25 2022] PUT /identity/v3/projects/19ab8049abae422a9447bf652c3e3e1f/users/a3fa584a87ac49d48ea129170ead8b3c/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:41:25.486571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8781c8-8cdb-4585-995a-d5c8b3516e82 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.486977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8781c8-8cdb-4585-995a-d5c8b3516e82 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.487540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8781c8-8cdb-4585-995a-d5c8b3516e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.507935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6f8781c8-8cdb-4585-995a-d5c8b3516e82 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:25.509170 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6f8781c8-8cdb-4585-995a-d5c8b3516e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:25.542918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:25.580351 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1397/2789] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:25.589939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:25.591833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:25.659511 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590d85-995d-418d-be34-7a1e1a2d56db admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:25.666935 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88589a5-e41f-4904-bca9-6799eba3a010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:25.667780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88589a5-e41f-4904-bca9-6799eba3a010 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:25.668128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88589a5-e41f-4904-bca9-6799eba3a010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:25.668522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88589a5-e41f-4904-bca9-6799eba3a010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:25.682300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88589a5-e41f-4904-bca9-6799eba3a010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:25.684105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88589a5-e41f-4904-bca9-6799eba3a010 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:25.695299 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1393/2790] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:28.883192 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8781c8-8cdb-4585-995a-d5c8b3516e82 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:28.916010 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8781c8-8cdb-4585-995a-d5c8b3516e82 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:28.927298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:28.929171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:28.931359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:28.931504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:28.938943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:28.967539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:28.968770 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:28.992672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1398/2791] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:30.247576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038f03b-3fc1-493c-985d-f3879cc70427 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:30.248032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038f03b-3fc1-493c-985d-f3879cc70427 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:30.248128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038f03b-3fc1-493c-985d-f3879cc70427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:30.279751 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6038f03b-3fc1-493c-985d-f3879cc70427 None None] MFA Rules not processed for user `a3fa584a87ac49d48ea129170ead8b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:30.281101 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6038f03b-3fc1-493c-985d-f3879cc70427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:30.380502 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1394/2792] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:30.385359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:30.405800 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf973-b645-4de2-92bc-eaaafaf6603c service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:30.413223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:30.413857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:30.414135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:30.414443 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:30.415095 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:30.417628 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:30.452537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1399/2793] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:41:30 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:41:30.456853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038f03b-3fc1-493c-985d-f3879cc70427 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:30.469943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038f03b-3fc1-493c-985d-f3879cc70427 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:30.512346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:30.531468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:30.532105 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:30.532546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:30.532993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:30.534052 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:30.537560 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:30.561145 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1395/2794] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:41:30 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:41:30.565258 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:30.576580 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63180a-ad35-43a8-89bd-4820c62bff47 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:30.581185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:30.581799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:30.582074 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:30.582363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:30.583025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:30.584673 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:30.595493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1400/2795] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:41:30.599846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:30.610287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4156-fe8c-4203-90aa-41bd3e0ddc66 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:30.615699 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:30.616359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:30.616639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:30.616994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] PATH_INFO: `/v3/projects/3a391906c08545ec9ccceacdfb51d841/users/c121cded0e8946fc9b22649997fe7260/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:30.632524 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a391906c08545ec9ccceacdfb51d841, user_id=c121cded0e8946fc9b22649997fe7260, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:30.635249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:30.650578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1396/2796] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:41:30 2022] PUT /identity/v3/projects/3a391906c08545ec9ccceacdfb51d841/users/c121cded0e8946fc9b22649997fe7260/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:41:30.654313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:30.665247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e26ed-c501-4fc7-9370-8e690891ee00 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:30.728325 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:30.728958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:30.729240 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:30.729512 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:30.730171 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:30.731844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:30.742275 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1401/2797] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:41:30.746457 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:30.757048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785bf4f-e317-4952-a43b-245d7d6a2419 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:30.761804 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:30.762514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:30.762799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:30.763074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] PATH_INFO: `/v3/projects/3a391906c08545ec9ccceacdfb51d841/users/c121cded0e8946fc9b22649997fe7260/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:30.765190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a391906c08545ec9ccceacdfb51d841, user_id=c121cded0e8946fc9b22649997fe7260, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:30.767902 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:30.780036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1397/2798] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:41:30 2022] PUT /identity/v3/projects/3a391906c08545ec9ccceacdfb51d841/users/c121cded0e8946fc9b22649997fe7260/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:41:32.727935 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:32.729936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:32.920384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb51f6-7aa5-47ab-8710-0364d03b4627 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:32.966716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:33.037162 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935f85-90ec-47c8-974c-12ab403ab7d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:33.038095 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935f85-90ec-47c8-974c-12ab403ab7d9 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.038772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935f85-90ec-47c8-974c-12ab403ab7d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.039329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935f85-90ec-47c8-974c-12ab403ab7d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.041550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e2935f85-90ec-47c8-974c-12ab403ab7d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:33.056439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2935f85-90ec-47c8-974c-12ab403ab7d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:33.059971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2935f85-90ec-47c8-974c-12ab403ab7d9 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:33.073077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1402/2799] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:33.098388 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:33.101833 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:33.183672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb41ba-63a6-40ae-b9db-ed487d7998e9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:33.187698 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923b4f8-adc9-49ec-b610-908c41ffeb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:33.188625 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923b4f8-adc9-49ec-b610-908c41ffeb4e service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.188930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923b4f8-adc9-49ec-b610-908c41ffeb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.189229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923b4f8-adc9-49ec-b610-908c41ffeb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.191137 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2923b4f8-adc9-49ec-b610-908c41ffeb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:33.202588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923b4f8-adc9-49ec-b610-908c41ffeb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:33.204239 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923b4f8-adc9-49ec-b610-908c41ffeb4e service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:33.214211 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1398/2800] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:33.382722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fed689-a6de-42eb-a971-d5525159b2b2 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.383008 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fed689-a6de-42eb-a971-d5525159b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.383434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fed689-a6de-42eb-a971-d5525159b2b2 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.385148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1403/2801] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:41:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:41:33.392246 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6141c-2f76-4ed5-b56d-7d2598f18ffb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.392604 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6141c-2f76-4ed5-b56d-7d2598f18ffb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.393285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6141c-2f76-4ed5-b56d-7d2598f18ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.424672 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fed6141c-2f76-4ed5-b56d-7d2598f18ffb None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:33.427719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fed6141c-2f76-4ed5-b56d-7d2598f18ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:33.450735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1399/2802] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:33.457991 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fed689-a6de-42eb-a971-d5525159b2b2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:33.462454 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-53fed689-a6de-42eb-a971-d5525159b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:33.657504 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fed689-a6de-42eb-a971-d5525159b2b2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:33.662505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f8b6a-d3f7-4558-98cd-c154a5f3468e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f639af7ae54e06b8baa10e77236c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:33.663228 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8b6a-d3f7-4558-98cd-c154a5f3468e service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.663610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8b6a-d3f7-4558-98cd-c154a5f3468e service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.663977 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8b6a-d3f7-4558-98cd-c154a5f3468e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.676986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f8b6a-d3f7-4558-98cd-c154a5f3468e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:33.679150 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f8b6a-d3f7-4558-98cd-c154a5f3468e service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:33.715231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1404/2803] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:33.865696 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e920d-f09d-45bd-97bb-d79969be725d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.865986 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e920d-f09d-45bd-97bb-d79969be725d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.866263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e920d-f09d-45bd-97bb-d79969be725d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.867654 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1400/2804] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:41:33.877644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb9a0-ded2-4164-8931-dacc00ed674f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.878182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb9a0-ded2-4164-8931-dacc00ed674f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.878182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb9a0-ded2-4164-8931-dacc00ed674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.914742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d3ddb9a0-ded2-4164-8931-dacc00ed674f None None] MFA Rules not processed for user `d4f75c3e044d4b0dbad6b16ea0599bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:33.921934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d3ddb9a0-ded2-4164-8931-dacc00ed674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:33.937942 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1405/2805] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:33.953767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e920d-f09d-45bd-97bb-d79969be725d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:33.966108 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e920d-f09d-45bd-97bb-d79969be725d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:33.975865 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e326a40-387e-4841-b10e-0fcaa8507097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:33.976491 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e326a40-387e-4841-b10e-0fcaa8507097 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:33.976767 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e326a40-387e-4841-b10e-0fcaa8507097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:33.977036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e326a40-387e-4841-b10e-0fcaa8507097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:33.985303 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e326a40-387e-4841-b10e-0fcaa8507097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:33.986817 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e326a40-387e-4841-b10e-0fcaa8507097 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:34.008901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1401/2806] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:34.118765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd31cd-39db-4afe-93bc-12e1b248b3c7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:34.119358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd31cd-39db-4afe-93bc-12e1b248b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:34.119872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd31cd-39db-4afe-93bc-12e1b248b3c7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:34.122617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1406/2807] 10.222.0.52 () {54 vars in 921 bytes} [Sun Sep 25 04:41:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 04:41:34.132456 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:34.133549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:34.134060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:34.159408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] MFA Rules not processed for user `079636b6d56943928420801c47555aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:34.161153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:34.174444 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1402/2808] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Sep 25 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:34.186214 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd31cd-39db-4afe-93bc-12e1b248b3c7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:34.205306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd31cd-39db-4afe-93bc-12e1b248b3c7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:34.217661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40560c49-a745-4b9f-b499-d4eaba71a72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:34.218210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560c49-a745-4b9f-b499-d4eaba71a72c service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:34.218527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560c49-a745-4b9f-b499-d4eaba71a72c service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:34.218804 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560c49-a745-4b9f-b499-d4eaba71a72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:34.231671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40560c49-a745-4b9f-b499-d4eaba71a72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:34.236071 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40560c49-a745-4b9f-b499-d4eaba71a72c service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:34.249545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1407/2809] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:41:34.340261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:34.341578 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:34.454035 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdc299-24a6-4833-9928-4e7bb0df267d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:34.461287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:34.461934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:34.462221 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:34.462556 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:34.464534 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:34.480937 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:34.483077 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:34.491646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:34.515058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1403/2810] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:36.036585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbac61-e8cb-4d58-92eb-4e7714a0597d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:36.037173 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbac61-e8cb-4d58-92eb-4e7714a0597d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:36.037387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbac61-e8cb-4d58-92eb-4e7714a0597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:36.077329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-23fbac61-e8cb-4d58-92eb-4e7714a0597d None None] MFA Rules not processed for user `c121cded0e8946fc9b22649997fe7260`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:36.078724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-23fbac61-e8cb-4d58-92eb-4e7714a0597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:36.158318 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1408/2811] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:36.172365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:36.174433 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:36.191359 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0f35-0ee0-47ba-84db-ed86fdad3c88 service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:36.200262 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:36.201301 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:36.201801 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:36.202300 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:36.273855 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:36.275774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:36.294182 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1404/2812] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:41:36.547140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddcf66-dd38-47ab-bdaf-c860ba31606d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:36.547664 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddcf66-dd38-47ab-bdaf-c860ba31606d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:36.548147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddcf66-dd38-47ab-bdaf-c860ba31606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:36.567976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9eddcf66-dd38-47ab-bdaf-c860ba31606d None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:36.569546 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9eddcf66-dd38-47ab-bdaf-c860ba31606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:36.581820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:36.643753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1409/2813] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:36.657594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:36.659075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:36.742783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2eee7-04f5-4f82-8e60-d2bfdafa51c6 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:36.748874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849aa9e-74a1-4a4f-b686-b465b2cbe631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:36.749494 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849aa9e-74a1-4a4f-b686-b465b2cbe631 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:36.749778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849aa9e-74a1-4a4f-b686-b465b2cbe631 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:36.750047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849aa9e-74a1-4a4f-b686-b465b2cbe631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:36.759173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849aa9e-74a1-4a4f-b686-b465b2cbe631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:36.761112 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849aa9e-74a1-4a4f-b686-b465b2cbe631 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:36.770679 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1405/2814] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:41:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:41:37.692342 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86487ca-9536-433f-8530-5b823c123009 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:37.692835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86487ca-9536-433f-8530-5b823c123009 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:37.692971 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86487ca-9536-433f-8530-5b823c123009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:37.721158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a86487ca-9536-433f-8530-5b823c123009 None None] MFA Rules not processed for user `a3fa584a87ac49d48ea129170ead8b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:37.725007 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a86487ca-9536-433f-8530-5b823c123009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:37.742385 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1410/2815] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:41:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:46.766750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=60 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:47.712864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=21 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:52.483238 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a8f90-fc4c-4329-a1fa-1f76fa04b56f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:52.483711 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a8f90-fc4c-4329-a1fa-1f76fa04b56f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:52.483903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a8f90-fc4c-4329-a1fa-1f76fa04b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:52.508823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-866a8f90-fc4c-4329-a1fa-1f76fa04b56f None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:41:52.510627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-866a8f90-fc4c-4329-a1fa-1f76fa04b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:52.521008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1406/2816] 10.222.0.52 () {58 vars in 967 bytes} [Sun Sep 25 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:41:52.534945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86487ca-9536-433f-8530-5b823c123009 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:52.549026 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86487ca-9536-433f-8530-5b823c123009 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:52.554332 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:52.555203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:52.555549 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:52.555892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:52.565102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:52.566911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:52.575958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1411/2817] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:41:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:41:54.814930 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a8f90-fc4c-4329-a1fa-1f76fa04b56f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:41:54.829620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a8f90-fc4c-4329-a1fa-1f76fa04b56f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:41:54.835289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:41:54.835907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:41:54.836179 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:41:54.836652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:41:54.838593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:41:54.851996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:41:54.853580 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:41:54.864944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1407/2818] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:41:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:42:02.572050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:04.007753 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:04.017132 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f06bc-c998-4ff0-ad95-e8fbc8134c6a service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:04.021425 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:04.022306 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:04.022734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:04.022917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:04.032442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:04.033874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:04.043527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1412/2819] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:42:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:42:04.859911 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=9 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:05.873901 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:05.886242 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6e3bd-6744-45b0-b317-1852507d5543 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:05.891916 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:05.892548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:05.892823 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:05.893124 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:05.895125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:05.908175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:05.909773 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:05.920893 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1408/2820] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:42:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:42:14.039204 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:15.916177 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:26.639357 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:26.641314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:26.702016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d336c-fac2-47d4-824c-4927dd5e2c78 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:26.705666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:26.706271 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:26.706583 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:26.706864 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:26.708601 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:26.766953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:26.768373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:26.777829 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1413/2821] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:42:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:42:32.535541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:32.544917 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755034c-8ff9-4347-8a04-e3e9ecfeba16 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:32.548424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:32.549006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:32.549280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:32.549549 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:32.551335 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:32.612128 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:32.613542 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:32.623061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1409/2822] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:42:35.675136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:35.677581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:35.705507 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e91be8-d1d8-4895-bcdf-3cf948b0b788 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:35.717143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:35.717143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:35.717143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:35.717143 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:35.719340 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:35.734513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:35.736209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:35.748055 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:35.750386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1414/2823] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:42:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:42:35.752090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:35.769003 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83af32d-8fed-4e0f-915b-30e4235f88e2 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:35.773894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:35.774828 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:35.775287 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:35.775565 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] PATH_INFO: `/v3/users/a9a2d9f4d9a0464789c9e761f48a4e68` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:35.776712 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a2d9f4d9a0464789c9e761f48a4e68)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:35.778668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:35.849674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a2d9f4d9a0464789c9e761f48a4e68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:35.850389 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a2d9f4d9a0464789c9e761f48a4e68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:35.858361 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a2d9f4d9a0464789c9e761f48a4e68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:35.866059 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a2d9f4d9a0464789c9e761f48a4e68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:35.877773 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad2817c5-b055-4f38-ad9b-b64f0c241013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a2d9f4d9a0464789c9e761f48a4e68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:35.884651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1410/2824] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:42:35 2022] DELETE /identity/v3/users/a9a2d9f4d9a0464789c9e761f48a4e68 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:42:36.066720 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.083067 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9729-71e9-4d46-98e5-b277e2bca07c service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.141665 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.142298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.142610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.142889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] PATH_INFO: `/v3/projects/7591ca9d80184274b0cc805afd938e64` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.144006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7591ca9d80184274b0cc805afd938e64)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.146036 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.189419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:36.194741 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7591ca9d80184274b0cc805afd938e64', 'request_id': 'req-66cfb588-b613-42ac-8dbd-46e93d042e27'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:36.201218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7591ca9d80184274b0cc805afd938e64', 'request_id': 'req-66cfb588-b613-42ac-8dbd-46e93d042e27'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:36.208918 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7591ca9d80184274b0cc805afd938e64', 'request_id': 'req-66cfb588-b613-42ac-8dbd-46e93d042e27'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:36.219997 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] The token cache is being invalidate because project 7591ca9d80184274b0cc805afd938e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:42:36.220291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:36.220923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66cfb588-b613-42ac-8dbd-46e93d042e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:42:36.222406 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1415/2825] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:42:36 2022] DELETE /identity/v3/projects/7591ca9d80184274b0cc805afd938e64 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:42:36.227899 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48d01-5f16-4634-aad7-f5d67715f0fd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.228191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48d01-5f16-4634-aad7-f5d67715f0fd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.228468 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48d01-5f16-4634-aad7-f5d67715f0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.248249 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b4c48d01-5f16-4634-aad7-f5d67715f0fd None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:42:36.249465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4c48d01-5f16-4634-aad7-f5d67715f0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:36.310230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1411/2826] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:42:36.318017 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200d40-447d-47b0-a144-ad7a68d127dd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.318301 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200d40-447d-47b0-a144-ad7a68d127dd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.318606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200d40-447d-47b0-a144-ad7a68d127dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.337828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a2200d40-447d-47b0-a144-ad7a68d127dd None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:42:36.339064 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a2200d40-447d-47b0-a144-ad7a68d127dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:36.346822 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1416/2827] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:42:36.351360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c48d01-5f16-4634-aad7-f5d67715f0fd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.360885 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c48d01-5f16-4634-aad7-f5d67715f0fd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.366113 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.366736 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.367019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.367321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.367961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:42:36.368260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.369851 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.371328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:36.382958 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1412/2828] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:42:36.386973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200d40-447d-47b0-a144-ad7a68d127dd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.396047 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200d40-447d-47b0-a144-ad7a68d127dd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.401149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.401733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.402009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.402278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.402963 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.404843 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.431186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1417/2829] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:42:36 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:42:36.435203 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.445027 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1cd8d-3519-4074-9714-94a830bf0952 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.499484 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.500079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.500357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.500626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.501247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.503184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.524233 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1413/2830] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:42:36 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:42:36.528335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.539101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032332f-75e4-402a-b48f-22bce38307da admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.543613 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.544218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.544481 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.544751 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.545386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.546981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.556779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1418/2831] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:42:36.560661 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.570590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56c58-e79e-40fe-bec5-bb0faa6efaeb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.575655 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20bcaf-6cc2-48e6-a42e-9db111d9e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.576244 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20bcaf-6cc2-48e6-a42e-9db111d9e1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.576530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20bcaf-6cc2-48e6-a42e-9db111d9e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.576842 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20bcaf-6cc2-48e6-a42e-9db111d9e1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.577531 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20bcaf-6cc2-48e6-a42e-9db111d9e1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.579265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20bcaf-6cc2-48e6-a42e-9db111d9e1d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.590330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1414/2832] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:42:36.594212 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.604775 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01732-4093-451e-91d0-e32566169ec7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.609348 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.609983 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.610263 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.610577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] PATH_INFO: `/v3/projects/452ae8b97ac5468c9b29e08d3d129b4e/users/7978763d6e664990b845cbaf3a848942/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.624798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452ae8b97ac5468c9b29e08d3d129b4e, user_id=7978763d6e664990b845cbaf3a848942, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.627493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.640157 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1419/2833] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:42:36 2022] PUT /identity/v3/projects/452ae8b97ac5468c9b29e08d3d129b4e/users/7978763d6e664990b845cbaf3a848942/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:42:36.650464 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127000-9c5b-420d-88f2-faff34048ff6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.650746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127000-9c5b-420d-88f2-faff34048ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.651048 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127000-9c5b-420d-88f2-faff34048ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.669959 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a6127000-9c5b-420d-88f2-faff34048ff6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:42:36.671216 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6127000-9c5b-420d-88f2-faff34048ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:36.729987 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1415/2834] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:42:36.739588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:36.741823 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:36.797577 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c453-5df3-419a-991a-f6e6c362f815 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:36.801160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:36.801758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:36.802035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:36.802308 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:36.811716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:36.813131 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:36.822469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1420/2835] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:42:40.719518 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748e92f-143d-4be8-805a-0fb660478e30 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:40.720043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748e92f-143d-4be8-805a-0fb660478e30 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:40.720152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748e92f-143d-4be8-805a-0fb660478e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:40.752759 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5748e92f-143d-4be8-805a-0fb660478e30 None None] MFA Rules not processed for user `7978763d6e664990b845cbaf3a848942`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:42:40.754001 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5748e92f-143d-4be8-805a-0fb660478e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:40.835495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1416/2836] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:42:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:42:40.850648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:42:40.852269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:40.931108 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74b31-ac31-47c2-83f7-d083fbab1363 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:42:40.936735 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:42:40.937350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:40.937634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:40.937908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:40.944019 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:40.946755 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:42:40.949052 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:42:40.959658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1421/2837] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:42:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:42:42.314227 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:42:42.314743 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:42:42.314863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:42:42.321861 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:42.338392 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] MFA Rules not processed for user `7978763d6e664990b845cbaf3a848942`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:42:42.339626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:42:42.347419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1417/2838] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:42:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:42:50.957737 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:52.333395 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:52.554923 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:43:52.556346 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:43:52.712715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4f79-cd73-42e3-bf5e-2ac2fc4d60ae service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:43:52.719965 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:43:52.720666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:43:52.720937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:43:52.721210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:43:52.722973 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:43:52.737550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:43:52.740054 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:43:52.752990 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1422/2839] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:43:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:44:02.746691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=63 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:14.242514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:44:14.244103 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:44:14.298788 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c028a-922c-4bfb-ae62-58de33cb4e0d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:44:14.302925 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24af63-3453-467f-8c61-af27fd79c30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:44:14.303590 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24af63-3453-467f-8c61-af27fd79c30b service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:44:14.303994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24af63-3453-467f-8c61-af27fd79c30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:44:14.304331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24af63-3453-467f-8c61-af27fd79c30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:44:14.306175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0a24af63-3453-467f-8c61-af27fd79c30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:44:14.317320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24af63-3453-467f-8c61-af27fd79c30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:44:14.318800 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24af63-3453-467f-8c61-af27fd79c30b service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:44:14.327153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1418/2840] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:44:15.428029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:44:15.437706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19310341-65d6-4cb8-832c-824a68c241db service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:44:15.441303 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:44:15.441904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:44:15.442184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:44:15.442494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:44:15.444244 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:44:15.478936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:44:15.480374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:44:15.500398 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1423/2841] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:44:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:44:24.323543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=21 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:25.497787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=18 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:14.384835 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:45:14.385436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:45:14.385436 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:45:14.404346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] MFA Rules not processed for user `7978763d6e664990b845cbaf3a848942`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:45:14.405558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:45:14.412487 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1419/2842] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:45:24.399293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:50.775229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:45:50.776915 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:45:50.792907 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1575483-1fa6-44ea-b706-fafab88056b6 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:45:50.800217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:45:50.801223 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:45:50.801705 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:45:50.802184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:45:50.805773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:45:50.820691 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:45:50.823358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:45:50.840879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1424/2843] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:45:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:45:50.851087 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:45:50.853845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:45:50.903067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1096a05-8702-4b69-9cfe-721134b8a099 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:45:50.907623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:45:50.908253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:45:50.908536 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:45:50.908808 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] PATH_INFO: `/v3/users/a3fa584a87ac49d48ea129170ead8b3c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:45:50.909945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fa584a87ac49d48ea129170ead8b3c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:45:50.911913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:45:50.959729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fa584a87ac49d48ea129170ead8b3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:50.960398 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fa584a87ac49d48ea129170ead8b3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:50.968942 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fa584a87ac49d48ea129170ead8b3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:50.976612 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fa584a87ac49d48ea129170ead8b3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:50.990147 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fa584a87ac49d48ea129170ead8b3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:50.996840 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1420/2844] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:45:50 2022] DELETE /identity/v3/users/a3fa584a87ac49d48ea129170ead8b3c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:45:51.174505 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:45:51.186135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3c0d0-8149-4a96-b261-45df724e7d32 service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:45:51.245069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:45:51.245698 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:45:51.245981 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:45:51.246262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] PATH_INFO: `/v3/projects/19ab8049abae422a9447bf652c3e3e1f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:45:51.247408 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ab8049abae422a9447bf652c3e3e1f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:45:51.249299 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:45:51.299598 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ab8049abae422a9447bf652c3e3e1f', 'request_id': 'req-7314953f-8da6-4556-b8a7-52bb9d6f2663'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.305684 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ab8049abae422a9447bf652c3e3e1f', 'request_id': 'req-7314953f-8da6-4556-b8a7-52bb9d6f2663'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.312668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ab8049abae422a9447bf652c3e3e1f', 'request_id': 'req-7314953f-8da6-4556-b8a7-52bb9d6f2663'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.323702 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] The token cache is being invalidate because project 19ab8049abae422a9447bf652c3e3e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:45:51.323989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.324610 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.326103 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1425/2845] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:45:51 2022] DELETE /identity/v3/projects/19ab8049abae422a9447bf652c3e3e1f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:45:51.330060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:45:51.331498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:45:51.344647 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12396be-888f-4802-9dfe-99af800554d8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:45:51.398807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:45:51.399943 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:45:51.400219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:45:51.400506 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] PATH_INFO: `/v3/users/c121cded0e8946fc9b22649997fe7260` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:45:51.401631 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c121cded0e8946fc9b22649997fe7260)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:45:51.403597 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:45:51.445703 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:51.448152 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c121cded0e8946fc9b22649997fe7260'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.449129 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c121cded0e8946fc9b22649997fe7260'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.456970 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c121cded0e8946fc9b22649997fe7260'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.464719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c121cded0e8946fc9b22649997fe7260'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.476424 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c121cded0e8946fc9b22649997fe7260'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.482903 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1421/2846] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:45:51 2022] DELETE /identity/v3/users/c121cded0e8946fc9b22649997fe7260 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:45:51.648471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:45:51.651040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:45:51.672328 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314953f-8da6-4556-b8a7-52bb9d6f2663 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:45:51.736677 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:45:51.737430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:45:51.737780 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:45:51.738122 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] PATH_INFO: `/v3/projects/3a391906c08545ec9ccceacdfb51d841` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:45:51.739347 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a391906c08545ec9ccceacdfb51d841)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:45:51.741316 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:45:51.764273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:51.793313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a391906c08545ec9ccceacdfb51d841', 'request_id': 'req-d9e08ba0-6112-4695-9087-50aef777292e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.799544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a391906c08545ec9ccceacdfb51d841', 'request_id': 'req-d9e08ba0-6112-4695-9087-50aef777292e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.807544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a391906c08545ec9ccceacdfb51d841', 'request_id': 'req-d9e08ba0-6112-4695-9087-50aef777292e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.818672 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] The token cache is being invalidate because project 3a391906c08545ec9ccceacdfb51d841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:45:51.818968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.819617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:45:51.821123 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1426/2847] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:45:51 2022] DELETE /identity/v3/projects/3a391906c08545ec9ccceacdfb51d841 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:46:01.479498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=13,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:01.815210 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:06.326620 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:06.328043 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:06.404253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e3e2-094b-419b-bfe9-df1a4d0c41f5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:06.451945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:06.452653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:06.453012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:06.453358 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:06.455429 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:06.522934 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:06.524281 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:06.535217 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1422/2848] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:46:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:46:09.399472 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:09.400895 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:09.412877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08ba0-6112-4695-9087-50aef777292e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:09.416420 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:09.417009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:09.417284 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:09.417556 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:09.419191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:09.432136 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:09.433537 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:09.444728 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1427/2849] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:46:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:46:16.530183 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=83 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:19.439903 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:25.920099 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:25.921665 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:25.997352 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea59480-f294-4198-8b07-b0f330403dbd service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.002488 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.003106 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.003384 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.003653 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] PATH_INFO: `/v3/users/7978763d6e664990b845cbaf3a848942` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.004758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7978763d6e664990b845cbaf3a848942)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.006702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.055382 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7978763d6e664990b845cbaf3a848942'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.056032 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7978763d6e664990b845cbaf3a848942'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.064058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7978763d6e664990b845cbaf3a848942'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.071213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7978763d6e664990b845cbaf3a848942'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.083420 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-819d368e-edce-477a-b5e1-66d89e72c673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7978763d6e664990b845cbaf3a848942'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.089230 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1423/2850] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:46:25 2022] DELETE /identity/v3/users/7978763d6e664990b845cbaf3a848942 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:46:26.255356 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.266112 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf9f4-ba32-4a0f-85c1-cf08c476c486 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.322758 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.323648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.323927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.324200 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] PATH_INFO: `/v3/projects/452ae8b97ac5468c9b29e08d3d129b4e` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.325302 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=452ae8b97ac5468c9b29e08d3d129b4e)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.327282 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.374050 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452ae8b97ac5468c9b29e08d3d129b4e', 'request_id': 'req-aad8ae68-fbc2-423c-9c58-3b355fcaf886'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.380273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452ae8b97ac5468c9b29e08d3d129b4e', 'request_id': 'req-aad8ae68-fbc2-423c-9c58-3b355fcaf886'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.388121 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452ae8b97ac5468c9b29e08d3d129b4e', 'request_id': 'req-aad8ae68-fbc2-423c-9c58-3b355fcaf886'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.398510 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] The token cache is being invalidate because project 452ae8b97ac5468c9b29e08d3d129b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:46:26.398805 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.399437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aad8ae68-fbc2-423c-9c58-3b355fcaf886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:46:26.400904 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1428/2851] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:46:26 2022] DELETE /identity/v3/projects/452ae8b97ac5468c9b29e08d3d129b4e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:46:26.406290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315b75-0214-4808-a05d-afcb49ecbc02 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.406602 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315b75-0214-4808-a05d-afcb49ecbc02 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.406879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315b75-0214-4808-a05d-afcb49ecbc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.463477 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f7315b75-0214-4808-a05d-afcb49ecbc02 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:46:26.464847 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f7315b75-0214-4808-a05d-afcb49ecbc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:26.508288 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:26.524582 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1424/2852] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:46:26.533167 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d05cc-7169-4b2f-b256-c27184a78a0e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.533452 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d05cc-7169-4b2f-b256-c27184a78a0e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.533729 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d05cc-7169-4b2f-b256-c27184a78a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.553434 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-847d05cc-7169-4b2f-b256-c27184a78a0e None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:46:26.554659 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-847d05cc-7169-4b2f-b256-c27184a78a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:26.562768 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1429/2853] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 04:46:26.566766 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7315b75-0214-4808-a05d-afcb49ecbc02 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.576691 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7315b75-0214-4808-a05d-afcb49ecbc02 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.581330 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.581923 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.582199 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.582508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.583148 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:46:26.583447 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.585036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.596929 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1425/2854] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:46:26.601035 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d05cc-7169-4b2f-b256-c27184a78a0e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.610773 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d05cc-7169-4b2f-b256-c27184a78a0e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.615446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.616039 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.616322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.616599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.617225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.619177 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.660217 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1430/2855] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:46:26 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:46:26.665272 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.675982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205b01-8ad0-4d7e-8547-5d86295cb75c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.730553 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.731146 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.731422 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.731692 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.732356 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.734253 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.754915 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1426/2856] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:46:26 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:46:26.759469 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.770750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001c12-00cb-4ef5-8d86-0f63dcc18958 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.775416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.776009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.776313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.776588 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.777229 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.778846 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.789447 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1431/2857] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:46:26.793370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.803220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ec048-aa3e-48c2-8ac3-93a99071fa9d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.807783 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082b19-b297-4364-9718-03fd97bcfbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.808373 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082b19-b297-4364-9718-03fd97bcfbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.808651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082b19-b297-4364-9718-03fd97bcfbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.808922 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082b19-b297-4364-9718-03fd97bcfbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.809593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082b19-b297-4364-9718-03fd97bcfbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.811219 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082b19-b297-4364-9718-03fd97bcfbb1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.821407 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1427/2858] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:46:26.825550 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.835937 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80c5e-f2c1-4782-a636-a1a142d7af57 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:26.840539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:26.841178 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.841459 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.842460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] PATH_INFO: `/v3/projects/a0922d0d6ef641eb9da0eea3427206a1/users/a33735d9a0e64b949131f3f4c0854fae/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.856623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0922d0d6ef641eb9da0eea3427206a1, user_id=a33735d9a0e64b949131f3f4c0854fae, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:26.859384 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:26.871733 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1432/2859] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:46:26 2022] PUT /identity/v3/projects/a0922d0d6ef641eb9da0eea3427206a1/users/a33735d9a0e64b949131f3f4c0854fae/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:46:26.876677 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e65aba-4089-43a6-b6c4-7f61d3874376 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:26.876964 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e65aba-4089-43a6-b6c4-7f61d3874376 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:26.877237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e65aba-4089-43a6-b6c4-7f61d3874376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:26.896481 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-86e65aba-4089-43a6-b6c4-7f61d3874376 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:46:26.897719 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86e65aba-4089-43a6-b6c4-7f61d3874376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:26.956785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1428/2860] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:46:26.966635 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:26.968437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:26.988951 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:27.026135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4121a2c-047d-4328-a127-17c8682dedaf admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:27.029742 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:27.030338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:27.030642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:27.030916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:27.039651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:27.041120 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:27.051236 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1433/2861] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:46:31.128737 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398df3b8-a2dc-4c59-8a0a-6e1a365b2cc8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:31.129280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398df3b8-a2dc-4c59-8a0a-6e1a365b2cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:31.129280 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398df3b8-a2dc-4c59-8a0a-6e1a365b2cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:31.170391 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-398df3b8-a2dc-4c59-8a0a-6e1a365b2cc8 None None] MFA Rules not processed for user `a33735d9a0e64b949131f3f4c0854fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:46:31.170579 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-398df3b8-a2dc-4c59-8a0a-6e1a365b2cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:31.226323 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:31.251158 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1429/2862] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:46:31.266383 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:31.267861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:31.346958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e9ab3-c280-4ea4-a9da-1e93c2b58b8d service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:31.352852 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:31.353471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:31.353749 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:31.354029 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:31.362682 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:31.364283 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:31.374078 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1434/2863] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:46:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:46:32.766722 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a1f0b-72b7-41b5-abaa-e8ee413f8456 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:32.767188 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a1f0b-72b7-41b5-abaa-e8ee413f8456 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:32.767307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a1f0b-72b7-41b5-abaa-e8ee413f8456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:32.787284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-140a1f0b-72b7-41b5-abaa-e8ee413f8456 None None] MFA Rules not processed for user `a33735d9a0e64b949131f3f4c0854fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:46:32.788523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-140a1f0b-72b7-41b5-abaa-e8ee413f8456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:32.795862 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1430/2864] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:46:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:46:33.116816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:33.127787 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb13c1-99be-4c91-9b10-17cbf8d0a318 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:33.131424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:33.132446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:33.132446 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:33.132668 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:33.134442 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:33.144844 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:33.146397 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:33.155291 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1435/2865] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:46:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:46:35.285932 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a1f0b-72b7-41b5-abaa-e8ee413f8456 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:35.296898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a1f0b-72b7-41b5-abaa-e8ee413f8456 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:35.300541 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e096b6a-5614-4392-a2a0-5d3c03a60b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:35.301150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e096b6a-5614-4392-a2a0-5d3c03a60b71 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:35.301425 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e096b6a-5614-4392-a2a0-5d3c03a60b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:35.301700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e096b6a-5614-4392-a2a0-5d3c03a60b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:35.303641 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7e096b6a-5614-4392-a2a0-5d3c03a60b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:35.314627 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e096b6a-5614-4392-a2a0-5d3c03a60b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:35.316076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e096b6a-5614-4392-a2a0-5d3c03a60b71 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:35.325210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1431/2866] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:46:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:46:40.344431 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:46:40.345857 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:40.362738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5091e-1752-40be-8faf-f1ffa8403d7f service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:46:40.368497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:46:40.369102 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:46:40.369388 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:46:40.369661 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:46:40.371430 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:46:40.384025 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:46:40.385600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:46:40.396908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1436/2867] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:46:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:46:45.320988 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=16 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:50.392224 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=64 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:17.616567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:47:17.617164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:47:17.617164 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:47:17.636853 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] MFA Rules not processed for user `a33735d9a0e64b949131f3f4c0854fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:47:17.638068 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:47:17.645007 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1432/2868] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:47:17.955274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:47:17.956799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:47:17.968465 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5d2b8-a54b-41cc-abb7-0dacddbefc5d service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:47:17.972232 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:47:17.972825 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:47:17.973101 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:47:17.973371 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:47:17.975094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:47:17.984521 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:47:17.986518 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:47:17.994338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1437/2869] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:47:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:47:18.324763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:47:18.326226 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:47:18.396269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef26839-a73d-47f3-b836-a74874622cfe None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:47:18.401329 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bf8f9-c50a-4918-afa8-d63262c1c804 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:47:18.401939 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bf8f9-c50a-4918-afa8-d63262c1c804 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:47:18.402220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bf8f9-c50a-4918-afa8-d63262c1c804 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:47:18.402530 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bf8f9-c50a-4918-afa8-d63262c1c804 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:47:18.404261 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a51bf8f9-c50a-4918-afa8-d63262c1c804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:47:18.416451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bf8f9-c50a-4918-afa8-d63262c1c804 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:47:18.418053 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bf8f9-c50a-4918-afa8-d63262c1c804 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:47:18.428071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1433/2870] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:47:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:47:21.098955 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:47:21.112801 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60aa9a-f69e-4295-aa02-193a684e9cd6 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:47:21.118370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:47:21.118976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:47:21.119255 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:47:21.119975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:47:21.121724 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:47:21.135621 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:47:21.137235 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:47:21.148989 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1438/2871] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:47:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:47:28.423792 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=35 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:31.144331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=12 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:10.974972 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cf53-06a1-498a-9ce4-fd12c13dc90f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:48:10.975489 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cf53-06a1-498a-9ce4-fd12c13dc90f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:48:10.975588 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cf53-06a1-498a-9ce4-fd12c13dc90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:48:10.996123 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f984cf53-06a1-498a-9ce4-fd12c13dc90f None None] MFA Rules not processed for user `a33735d9a0e64b949131f3f4c0854fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:48:10.997454 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f984cf53-06a1-498a-9ce4-fd12c13dc90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:48:11.005431 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1434/2872] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:48:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:48:20.989720 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:57.637999 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:48:57.649087 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377cb9e-413f-482b-ae7d-4610b0fdb9ee service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:48:57.654066 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:48:57.654683 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:48:57.654962 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:48:57.655234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:48:57.656945 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:48:57.668552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:48:57.670100 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:48:57.680531 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1439/2873] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:48:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:49:01.636567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee873-af3f-4293-b4d5-c3d2959eb8dc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:49:01.637154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee873-af3f-4293-b4d5-c3d2959eb8dc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:49:01.637263 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee873-af3f-4293-b4d5-c3d2959eb8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:49:01.655567 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bcaee873-af3f-4293-b4d5-c3d2959eb8dc None None] MFA Rules not processed for user `a33735d9a0e64b949131f3f4c0854fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:49:01.656763 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bcaee873-af3f-4293-b4d5-c3d2959eb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:49:01.664061 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1435/2874] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:49:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:49:07.676320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:11.485038 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:49:11.497068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a8516-6309-484d-afd2-0dbafa25507b service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:49:11.502815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:49:11.503419 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:49:11.503700 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:49:11.503975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:49:11.506225 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:49:11.518968 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:49:11.521183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:49:11.532049 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1440/2875] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:49:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:49:11.650404 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:21.527424 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:29.601321 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee873-af3f-4293-b4d5-c3d2959eb8dc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:29.614944 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee873-af3f-4293-b4d5-c3d2959eb8dc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:29.620086 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:29.620724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:29.621006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:29.621286 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:29.623376 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:29.636469 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:29.638307 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:29.656163 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1436/2876] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 04:50:29.668013 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:29.682018 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac381b-0db8-458b-aa8c-a1bb6628a274 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:29.688412 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:29.688853 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:29.689135 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:29.689413 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] PATH_INFO: `/v3/users/a33735d9a0e64b949131f3f4c0854fae` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:29.690597 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33735d9a0e64b949131f3f4c0854fae)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:29.692544 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:29.740535 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33735d9a0e64b949131f3f4c0854fae'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:29.747571 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33735d9a0e64b949131f3f4c0854fae'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:29.748238 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33735d9a0e64b949131f3f4c0854fae'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:29.749004 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33735d9a0e64b949131f3f4c0854fae'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:29.755979 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d46d34dd-334b-45c2-96ab-9dd55f505170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33735d9a0e64b949131f3f4c0854fae'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:29.773396 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1441/2877] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:50:29 2022] DELETE /identity/v3/users/a33735d9a0e64b949131f3f4c0854fae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:29.947458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:29.959495 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2745-9f7b-41f8-9324-445925d29553 service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.017229 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.017854 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.018132 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.018441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] PATH_INFO: `/v3/projects/a0922d0d6ef641eb9da0eea3427206a1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.019558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0922d0d6ef641eb9da0eea3427206a1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.021485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.067315 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0922d0d6ef641eb9da0eea3427206a1', 'request_id': 'req-a79ca2b0-4b5c-4869-8702-19f559a6d008'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:30.073264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0922d0d6ef641eb9da0eea3427206a1', 'request_id': 'req-a79ca2b0-4b5c-4869-8702-19f559a6d008'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:30.082058 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0922d0d6ef641eb9da0eea3427206a1', 'request_id': 'req-a79ca2b0-4b5c-4869-8702-19f559a6d008'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:30.092533 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] The token cache is being invalidate because project a0922d0d6ef641eb9da0eea3427206a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:50:30.092846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:30.093498 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a79ca2b0-4b5c-4869-8702-19f559a6d008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:30.095046 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1437/2878] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:50:29 2022] DELETE /identity/v3/projects/a0922d0d6ef641eb9da0eea3427206a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:30.099959 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38cea2-502e-4693-89e8-2175d4aff39b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.100247 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38cea2-502e-4693-89e8-2175d4aff39b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.100522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38cea2-502e-4693-89e8-2175d4aff39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.120953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dc38cea2-502e-4693-89e8-2175d4aff39b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:30.122158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dc38cea2-502e-4693-89e8-2175d4aff39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:30.179545 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1442/2879] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:30.187044 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2b92-e8ae-4187-8dd2-058950b42bbc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.187336 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2b92-e8ae-4187-8dd2-058950b42bbc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.188090 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2b92-e8ae-4187-8dd2-058950b42bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.208223 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aa2d2b92-e8ae-4187-8dd2-058950b42bbc None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:30.209434 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa2d2b92-e8ae-4187-8dd2-058950b42bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:30.217252 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1438/2880] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:30.221375 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38cea2-502e-4693-89e8-2175d4aff39b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:30.230854 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38cea2-502e-4693-89e8-2175d4aff39b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.235579 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.236218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.236497 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.236772 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.237417 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:50:30.237722 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.239358 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.251320 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1443/2881] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:50:30.255746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d2b92-e8ae-4187-8dd2-058950b42bbc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:30.265240 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d2b92-e8ae-4187-8dd2-058950b42bbc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.270543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.271140 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.271419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.271717 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.272356 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.274255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.302029 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1439/2882] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:50:30 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:50:30.306266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:30.316841 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e87e5-5e68-4b3a-9e7e-8f5d724e7e66 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.372392 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.373037 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.373336 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.373611 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.374261 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.376835 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.385068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:30.399813 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1444/2883] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:50:30 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:50:30.403926 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:30.414168 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a851-af75-4bf6-8237-5dfcfda08d2e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.418802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.419399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.419678 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.419951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.420593 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.422702 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.432645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1440/2884] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:50:30.436360 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:30.446745 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb559fab-5139-4786-bfc8-90b4b5b76281 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.451658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37e4ee-028a-4695-8d41-ab7fbb329880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.452260 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e4ee-028a-4695-8d41-ab7fbb329880 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.452540 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e4ee-028a-4695-8d41-ab7fbb329880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.452815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e4ee-028a-4695-8d41-ab7fbb329880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.453522 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37e4ee-028a-4695-8d41-ab7fbb329880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.455148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37e4ee-028a-4695-8d41-ab7fbb329880 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.465532 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1445/2885] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:50:30.469639 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:30.479573 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c3d4e-399a-4976-8764-7f3aa1db5b53 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.484423 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.485624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.485961 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.486320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] PATH_INFO: `/v3/projects/d087722da6954f28a1d496f5c1acd3c6/users/ea9032366c3147afa655e905ba279300/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.501381 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d087722da6954f28a1d496f5c1acd3c6, user_id=ea9032366c3147afa655e905ba279300, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.504067 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.516656 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1441/2886] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:50:30 2022] PUT /identity/v3/projects/d087722da6954f28a1d496f5c1acd3c6/users/ea9032366c3147afa655e905ba279300/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:30.527527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39003-1d17-4902-b013-eaf6fd3bffe4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.527874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39003-1d17-4902-b013-eaf6fd3bffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.528159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39003-1d17-4902-b013-eaf6fd3bffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.555798 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-74e39003-1d17-4902-b013-eaf6fd3bffe4 None None] MFA Rules not processed for user `ea9032366c3147afa655e905ba279300`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:30.557015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-74e39003-1d17-4902-b013-eaf6fd3bffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:30.620185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1446/2887] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:30.631019 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:30.632798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:30.647629 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:30.708563 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db98d-2a5a-4412-b3f8-7aced5922290 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:30.713994 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc6cd6-27d9-409e-b18e-3c4a84623a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079636b6d56943928420801c47555aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:30.714618 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6cd6-27d9-409e-b18e-3c4a84623a98 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:30.714898 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6cd6-27d9-409e-b18e-3c4a84623a98 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:30.715175 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6cd6-27d9-409e-b18e-3c4a84623a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:30.722845 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc6cd6-27d9-409e-b18e-3c4a84623a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:30.724408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc6cd6-27d9-409e-b18e-3c4a84623a98 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:30.733013 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1442/2888] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:35.911934 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e39003-1d17-4902-b013-eaf6fd3bffe4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:35.975073 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e39003-1d17-4902-b013-eaf6fd3bffe4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:35.979568 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:35.980193 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:35.980474 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:35.980746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] PATH_INFO: `/v3/users/ea9032366c3147afa655e905ba279300` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:35.981861 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9032366c3147afa655e905ba279300)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:35.983814 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.029767 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9032366c3147afa655e905ba279300'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.037708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9032366c3147afa655e905ba279300'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.038322 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9032366c3147afa655e905ba279300'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.038958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9032366c3147afa655e905ba279300'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.045777 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9032366c3147afa655e905ba279300'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.051486 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:36.065644 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1447/2889] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:50:35 2022] DELETE /identity/v3/users/ea9032366c3147afa655e905ba279300 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:36.070109 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.070626 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.070735 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.089501 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:36.090878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:36.148293 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1443/2890] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:36.158335 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:36.159760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:36.215756 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377da5ea-c8db-40e8-998a-7662e7c40805 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:36.219407 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aa3d9-fa69-4d12-927a-00e5c8329e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:36.220496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa3d9-fa69-4d12-927a-00e5c8329e1d service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.220774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa3d9-fa69-4d12-927a-00e5c8329e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.221046 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa3d9-fa69-4d12-927a-00e5c8329e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.229936 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aa3d9-fa69-4d12-927a-00e5c8329e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:36.231338 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aa3d9-fa69-4d12-927a-00e5c8329e1d service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.241130 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1448/2891] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:36.507110 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:36.508546 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:36.520863 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add7aa-26b2-4d6e-ac6c-cb889fb0121c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:36.525508 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:36.526135 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.526441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.526715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] PATH_INFO: `/v3/projects/d087722da6954f28a1d496f5c1acd3c6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.527821 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d087722da6954f28a1d496f5c1acd3c6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:36.529724 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.578255 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd087722da6954f28a1d496f5c1acd3c6', 'request_id': 'req-dd34cab0-38cd-441a-b211-305ebb0a3f81'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.584832 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd087722da6954f28a1d496f5c1acd3c6', 'request_id': 'req-dd34cab0-38cd-441a-b211-305ebb0a3f81'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.591802 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd087722da6954f28a1d496f5c1acd3c6', 'request_id': 'req-dd34cab0-38cd-441a-b211-305ebb0a3f81'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.603864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] The token cache is being invalidate because project d087722da6954f28a1d496f5c1acd3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:50:36.604150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.604780 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dd34cab0-38cd-441a-b211-305ebb0a3f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:36.606260 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1444/2892] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:50:36 2022] DELETE /identity/v3/projects/d087722da6954f28a1d496f5c1acd3c6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:36.611269 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6b2a0-11d5-448f-b24b-d98a1a7eaf9d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.611645 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6b2a0-11d5-448f-b24b-d98a1a7eaf9d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.611978 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6b2a0-11d5-448f-b24b-d98a1a7eaf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.631191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a1a6b2a0-11d5-448f-b24b-d98a1a7eaf9d None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:36.632393 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a1a6b2a0-11d5-448f-b24b-d98a1a7eaf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:36.690986 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1449/2893] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:36.698622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b8141-efed-4886-abef-e48c95d692d3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.698914 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b8141-efed-4886-abef-e48c95d692d3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.699192 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b8141-efed-4886-abef-e48c95d692d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.719201 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b60b8141-efed-4886-abef-e48c95d692d3 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:36.720439 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b60b8141-efed-4886-abef-e48c95d692d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:36.728264 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1445/2894] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:36.732369 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6b2a0-11d5-448f-b24b-d98a1a7eaf9d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:36.742031 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6b2a0-11d5-448f-b24b-d98a1a7eaf9d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:36.746666 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:36.747262 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.747543 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.747821 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.748471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:50:36.748898 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:36.750581 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.762623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1450/2895] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:50:36.767064 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b8141-efed-4886-abef-e48c95d692d3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:36.776393 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b8141-efed-4886-abef-e48c95d692d3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:36.781012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:36.781606 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.781887 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.782190 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.782874 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:36.785148 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.801773 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:36.815882 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1446/2896] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:50:36 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:50:36.820022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:36.831183 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a9295-e635-4e0e-9332-350743111cd6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:36.888960 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:36.889609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.889897 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.890179 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.890877 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:36.893437 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.914209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1451/2897] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:50:36 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 04:50:36.918309 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:36.928669 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92298f3-bec3-46ea-9fa5-37192b4064be admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:36.933317 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:36.933913 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.934193 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.934503 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.935173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:36.936778 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.947194 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1447/2898] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:50:36.952218 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:36.962913 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246a4b-6a75-45f0-99c4-7dd48fc9cd23 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:36.968272 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1068827-e080-484e-b6db-46ceabdda19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:36.968908 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068827-e080-484e-b6db-46ceabdda19c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:36.969209 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068827-e080-484e-b6db-46ceabdda19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:36.969508 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068827-e080-484e-b6db-46ceabdda19c admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:36.970158 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1068827-e080-484e-b6db-46ceabdda19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:36.971862 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1068827-e080-484e-b6db-46ceabdda19c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:36.973185 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:36.986373 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1452/2899] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:50:36.990285 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.000292 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e27de-badd-491b-a3a3-93b011d4423f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.005572 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.006158 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.006466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.006742 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] PATH_INFO: `/v3/projects/cd027f009f8842269cd159594a425105/users/abd3a43b1284434888cdc52ace643dab/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.021554 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd027f009f8842269cd159594a425105, user_id=abd3a43b1284434888cdc52ace643dab, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.024247 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.037125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1448/2900] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:50:36 2022] PUT /identity/v3/projects/cd027f009f8842269cd159594a425105/users/abd3a43b1284434888cdc52ace643dab/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:50:37.047111 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19ddc2-e631-4ee5-a268-978f1c499654 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.047400 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19ddc2-e631-4ee5-a268-978f1c499654 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.048234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19ddc2-e631-4ee5-a268-978f1c499654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.077765 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1c19ddc2-e631-4ee5-a268-978f1c499654 None None] MFA Rules not processed for user `abd3a43b1284434888cdc52ace643dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:37.079055 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1c19ddc2-e631-4ee5-a268-978f1c499654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:37.148848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1453/2901] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:37.153450 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.214016 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634b4f9-66b7-47ba-8746-1261840d6243 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.218747 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.219346 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.219611 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.219884 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.220514 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.222445 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.250651 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1449/2902] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:50:37 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:50:37.255363 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19ddc2-e631-4ee5-a268-978f1c499654 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.266781 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19ddc2-e631-4ee5-a268-978f1c499654 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.322727 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.323337 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.323617 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.323891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.324517 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.326738 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.346251 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1454/2903] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:50:37 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:50:37.350298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.361139 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf353f52-6f58-496d-8d8b-c4d3d38dc7e2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.365700 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.366279 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.366585 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.366857 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.367493 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.369075 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.379894 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1450/2904] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:50:37.383873 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.393786 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f3d6c-70db-4d02-85bb-27a99531c655 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.398449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.399096 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.399380 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.399655 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] PATH_INFO: `/v3/projects/52e17534f72a42bdb065048480df848e/users/fff941e3804f41de945f1aecf801d4d4/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.414548 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e17534f72a42bdb065048480df848e, user_id=fff941e3804f41de945f1aecf801d4d4, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.417202 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.430529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1455/2905] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:50:37 2022] PUT /identity/v3/projects/52e17534f72a42bdb065048480df848e/users/fff941e3804f41de945f1aecf801d4d4/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:37.434419 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.444269 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539d44-1b1e-48b5-8247-ea9cbd65dcf8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.499173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeea48f-0f71-462d-a987-3f4eece70846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.499769 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea48f-0f71-462d-a987-3f4eece70846 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.500047 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea48f-0f71-462d-a987-3f4eece70846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.500318 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea48f-0f71-462d-a987-3f4eece70846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.501008 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeea48f-0f71-462d-a987-3f4eece70846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.502601 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeea48f-0f71-462d-a987-3f4eece70846 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.512220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1451/2906] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 04:50:37.516249 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.526473 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652e6bf-fae5-44fe-ad17-626fa5a3794c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.531069 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.531712 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.532494 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.532769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] PATH_INFO: `/v3/projects/52e17534f72a42bdb065048480df848e/users/fff941e3804f41de945f1aecf801d4d4/roles/1875ffca62eb455b8c2d5afc7954f389` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.534715 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e17534f72a42bdb065048480df848e, user_id=fff941e3804f41de945f1aecf801d4d4, role_id=1875ffca62eb455b8c2d5afc7954f389)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.537339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.547341 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1456/2907] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:50:37 2022] PUT /identity/v3/projects/52e17534f72a42bdb065048480df848e/users/fff941e3804f41de945f1aecf801d4d4/roles/1875ffca62eb455b8c2d5afc7954f389 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 04:50:37.559125 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e765ba-309f-43f5-97c2-41258c4c4d63 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.559408 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e765ba-309f-43f5-97c2-41258c4c4d63 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.559676 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e765ba-309f-43f5-97c2-41258c4c4d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.586886 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-44e765ba-309f-43f5-97c2-41258c4c4d63 None None] MFA Rules not processed for user `fff941e3804f41de945f1aecf801d4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:37.588098 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-44e765ba-309f-43f5-97c2-41258c4c4d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:37.604576 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:37.655945 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1452/2908] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:37.667648 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.669350 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:37.711595 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:37.728651 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ff55b-815b-43b9-b0a8-dca929f4d5f5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.732416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.733022 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.733305 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.733584 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.743847 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.745292 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.754806 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1457/2909] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:37.829839 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e765ba-309f-43f5-97c2-41258c4c4d63 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:37.839519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e765ba-309f-43f5-97c2-41258c4c4d63 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:37.843187 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749990b2-527b-4d26-9d62-935b3ddaf632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:37.843793 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749990b2-527b-4d26-9d62-935b3ddaf632 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:37.844071 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749990b2-527b-4d26-9d62-935b3ddaf632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:37.844345 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749990b2-527b-4d26-9d62-935b3ddaf632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:37.901368 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749990b2-527b-4d26-9d62-935b3ddaf632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:37.903005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749990b2-527b-4d26-9d62-935b3ddaf632 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:37.912466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1453/2910] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:40.617592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:40.677867 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb6e86-cc09-4b33-a9fe-c05da8431abd service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:40.682300 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:40.682947 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:40.683222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:40.683493 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] PATH_INFO: `/v3/users/abd3a43b1284434888cdc52ace643dab` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:40.684589 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd3a43b1284434888cdc52ace643dab)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:40.686529 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:40.729600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd3a43b1284434888cdc52ace643dab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:40.736642 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd3a43b1284434888cdc52ace643dab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:40.737276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd3a43b1284434888cdc52ace643dab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:40.737872 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd3a43b1284434888cdc52ace643dab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:40.744746 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd3a43b1284434888cdc52ace643dab'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:40.761191 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1458/2911] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:50:40 2022] DELETE /identity/v3/users/abd3a43b1284434888cdc52ace643dab => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:40.765776 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:40.766760 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:40.766870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:40.785836 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:40.787082 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:40.843354 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1454/2912] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:40.853585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:40.855028 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:40.910708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c8f5-e32a-456f-a824-13bc9280713d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:40.914273 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:40.914900 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:40.915176 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:40.915449 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:40.924222 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:40.925637 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:40.934874 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1459/2913] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:41.201715 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:41.204764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:41.219009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cf3c8-7550-4a5f-a5f1-5e0611550840 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:41.224006 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:41.224645 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:41.224931 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:41.225328 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] PATH_INFO: `/v3/projects/cd027f009f8842269cd159594a425105` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:41.226441 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd027f009f8842269cd159594a425105)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:41.228320 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:41.275879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:41.277167 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd027f009f8842269cd159594a425105', 'request_id': 'req-110f3900-ac7f-4e75-8184-d6546c53e4ec'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.284522 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd027f009f8842269cd159594a425105', 'request_id': 'req-110f3900-ac7f-4e75-8184-d6546c53e4ec'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.291982 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd027f009f8842269cd159594a425105', 'request_id': 'req-110f3900-ac7f-4e75-8184-d6546c53e4ec'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.302497 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] The token cache is being invalidate because project cd027f009f8842269cd159594a425105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:50:41.302789 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.303440 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.304983 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1455/2914] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:50:41 2022] DELETE /identity/v3/projects/cd027f009f8842269cd159594a425105 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:41.308964 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:41.314281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:41.320576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35796174-bc49-471e-bdbc-21566cd00bce service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:41.376711 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:41.377329 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:41.377612 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:41.377889 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] PATH_INFO: `/v3/users/fff941e3804f41de945f1aecf801d4d4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:41.379014 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff941e3804f41de945f1aecf801d4d4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:41.380929 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:41.424287 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff941e3804f41de945f1aecf801d4d4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.431147 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff941e3804f41de945f1aecf801d4d4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.431766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff941e3804f41de945f1aecf801d4d4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.432370 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff941e3804f41de945f1aecf801d4d4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.439680 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9934a981-3dd7-4351-a201-3fe33e1e509c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff941e3804f41de945f1aecf801d4d4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.457160 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1460/2915] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:50:41 2022] DELETE /identity/v3/users/fff941e3804f41de945f1aecf801d4d4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:41.722460 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:41.723949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:41.740022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3900-ac7f-4e75-8184-d6546c53e4ec admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:41.796844 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:41.797967 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:41.798331 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:41.798539 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] PATH_INFO: `/v3/projects/52e17534f72a42bdb065048480df848e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:41.799668 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e17534f72a42bdb065048480df848e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:41.801584 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:41.848360 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e17534f72a42bdb065048480df848e', 'request_id': 'req-03d21216-e36d-4923-b1f3-59fb288e35c7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.854289 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e17534f72a42bdb065048480df848e', 'request_id': 'req-03d21216-e36d-4923-b1f3-59fb288e35c7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.861871 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e17534f72a42bdb065048480df848e', 'request_id': 'req-03d21216-e36d-4923-b1f3-59fb288e35c7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.872326 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] The token cache is being invalidate because project 52e17534f72a42bdb065048480df848e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:50:41.872622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.873277 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03d21216-e36d-4923-b1f3-59fb288e35c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:41.874985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1456/2916] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:50:41 2022] DELETE /identity/v3/projects/52e17534f72a42bdb065048480df848e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:41.881542 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e2cd-6468-4d7d-a781-c4d9c038c9c6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:41.882048 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e2cd-6468-4d7d-a781-c4d9c038c9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:41.882148 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e2cd-6468-4d7d-a781-c4d9c038c9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:41.903515 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-59b8e2cd-6468-4d7d-a781-c4d9c038c9c6 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:41.904769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-59b8e2cd-6468-4d7d-a781-c4d9c038c9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:41.966506 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1461/2917] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:41.974714 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985796-bf6e-464c-9601-c027e299a947 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:41.975005 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985796-bf6e-464c-9601-c027e299a947 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:41.975284 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985796-bf6e-464c-9601-c027e299a947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:41.995365 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-70985796-bf6e-464c-9601-c027e299a947 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:41.996623 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-70985796-bf6e-464c-9601-c027e299a947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:42.004634 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1457/2918] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:42.009119 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e2cd-6468-4d7d-a781-c4d9c038c9c6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:42.018750 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e2cd-6468-4d7d-a781-c4d9c038c9c6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:42.023314 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:42.023911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.024187 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.024460 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.025274 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:50:42.025394 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:42.027068 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:42.039163 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1462/2919] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 04:50:42.043383 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985796-bf6e-464c-9601-c027e299a947 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:42.053437 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985796-bf6e-464c-9601-c027e299a947 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:42.058191 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:42.058807 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.059094 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.059370 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.060012 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:42.062159 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:42.088523 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1458/2920] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:50:42 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:50:42.092554 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:42.103077 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd3f33-eb7e-4020-b000-74c903e7ec1f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:42.107658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:42.162315 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b83344-365a-46af-9532-92204697f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:42.162953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83344-365a-46af-9532-92204697f34f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.163233 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83344-365a-46af-9532-92204697f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.163509 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83344-365a-46af-9532-92204697f34f admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.164142 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b83344-365a-46af-9532-92204697f34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:42.166094 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b83344-365a-46af-9532-92204697f34f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:42.186939 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1463/2921] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:50:42 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:50:42.191171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:42.202036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887590e-de33-44cd-88fb-cd576502f4fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:42.206674 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:42.207268 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.207543 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.207811 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.208442 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:42.210020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:42.220144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1459/2922] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:50:42.223916 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b83344-365a-46af-9532-92204697f34f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:42.233671 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b83344-365a-46af-9532-92204697f34f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:42.239016 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dc155-d172-4644-a094-28b92f587a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:42.239606 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dc155-d172-4644-a094-28b92f587a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.239892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dc155-d172-4644-a094-28b92f587a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.240186 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dc155-d172-4644-a094-28b92f587a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.240827 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dc155-d172-4644-a094-28b92f587a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:42.242444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dc155-d172-4644-a094-28b92f587a0c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:42.252848 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1464/2923] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:50:42.256864 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:42.267466 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e893-3236-44ed-99b3-1b995cd76e67 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:42.272111 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:42.272756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.273036 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.273308 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] PATH_INFO: `/v3/projects/2701f51ab21346ba83c1b8fb515219e4/users/f5bd68a3a2884b9981329597e9407876/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.288528 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2701f51ab21346ba83c1b8fb515219e4, user_id=f5bd68a3a2884b9981329597e9407876, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:42.291235 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:42.304120 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1460/2924] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:50:42 2022] PUT /identity/v3/projects/2701f51ab21346ba83c1b8fb515219e4/users/f5bd68a3a2884b9981329597e9407876/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:42.314416 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ed65a-903a-4d69-ae7a-ba11b59dc2d6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.314734 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ed65a-903a-4d69-ae7a-ba11b59dc2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.315015 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ed65a-903a-4d69-ae7a-ba11b59dc2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.342752 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-052ed65a-903a-4d69-ae7a-ba11b59dc2d6 None None] MFA Rules not processed for user `f5bd68a3a2884b9981329597e9407876`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:42.343975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-052ed65a-903a-4d69-ae7a-ba11b59dc2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:42.407670 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1465/2925] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:42.418236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:42.419949 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:42.425256 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:42.478895 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb924c36-f2d7-4134-a335-32412e00a5a4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:42.482483 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f427a38-cec4-4ec6-9353-b3e2ec15da32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:42.483076 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f427a38-cec4-4ec6-9353-b3e2ec15da32 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:42.483350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f427a38-cec4-4ec6-9353-b3e2ec15da32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:42.483619 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f427a38-cec4-4ec6-9353-b3e2ec15da32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:42.491705 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f427a38-cec4-4ec6-9353-b3e2ec15da32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:42.493153 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f427a38-cec4-4ec6-9353-b3e2ec15da32 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:42.502014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1461/2926] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:47.817376 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ed65a-903a-4d69-ae7a-ba11b59dc2d6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:47.881387 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ed65a-903a-4d69-ae7a-ba11b59dc2d6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:47.885922 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:47.886585 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:47.886868 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:47.887149 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] PATH_INFO: `/v3/users/f5bd68a3a2884b9981329597e9407876` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:47.888311 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5bd68a3a2884b9981329597e9407876)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:47.890234 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:47.911886 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:47.939701 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5bd68a3a2884b9981329597e9407876'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:47.947197 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5bd68a3a2884b9981329597e9407876'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:47.947839 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5bd68a3a2884b9981329597e9407876'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:47.948462 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5bd68a3a2884b9981329597e9407876'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:47.956386 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5bd68a3a2884b9981329597e9407876'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:47.974982 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1466/2927] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:50:47 2022] DELETE /identity/v3/users/f5bd68a3a2884b9981329597e9407876 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:47.980056 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:47.980781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:47.980985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.000276 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:48.001951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:48.059304 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1462/2928] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:48.069779 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.071253 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:48.128040 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa662b2-d975-41d4-9915-33f6ec8527c3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.131708 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30fce9-4690-44b2-a5b7-24a207a68cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.132317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30fce9-4690-44b2-a5b7-24a207a68cfc service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.132600 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30fce9-4690-44b2-a5b7-24a207a68cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.132879 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30fce9-4690-44b2-a5b7-24a207a68cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.142438 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30fce9-4690-44b2-a5b7-24a207a68cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.143911 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30fce9-4690-44b2-a5b7-24a207a68cfc service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.153252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1467/2929] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:48.406707 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.408297 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:48.423750 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb05be5-dd78-42b7-bd54-918723907530 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.428410 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.429879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.430166 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.430813 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] PATH_INFO: `/v3/projects/2701f51ab21346ba83c1b8fb515219e4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.432000 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2701f51ab21346ba83c1b8fb515219e4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.433846 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.480028 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2701f51ab21346ba83c1b8fb515219e4', 'request_id': 'req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:48.486878 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2701f51ab21346ba83c1b8fb515219e4', 'request_id': 'req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:48.494037 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2701f51ab21346ba83c1b8fb515219e4', 'request_id': 'req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:48.504881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] The token cache is being invalidate because project 2701f51ab21346ba83c1b8fb515219e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:50:48.505171 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:48.505786 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4bb1e3a0-5974-4c6c-8c08-05d189ceca2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:50:48.507282 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1463/2930] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:50:48 2022] DELETE /identity/v3/projects/2701f51ab21346ba83c1b8fb515219e4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:48.512339 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0459c4-e964-45f0-af4b-aa2b17de611b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.512634 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0459c4-e964-45f0-af4b-aa2b17de611b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.512917 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0459c4-e964-45f0-af4b-aa2b17de611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.533592 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0b0459c4-e964-45f0-af4b-aa2b17de611b None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:48.534842 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0b0459c4-e964-45f0-af4b-aa2b17de611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:48.592930 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1468/2931] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:48.600781 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dad73d-e264-4908-9d4f-571ee96df6f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.601069 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dad73d-e264-4908-9d4f-571ee96df6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.601342 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dad73d-e264-4908-9d4f-571ee96df6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.621500 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c6dad73d-e264-4908-9d4f-571ee96df6f5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:48.622749 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c6dad73d-e264-4908-9d4f-571ee96df6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:48.631200 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1464/2932] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:48.635281 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0459c4-e964-45f0-af4b-aa2b17de611b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.644892 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0459c4-e964-45f0-af4b-aa2b17de611b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.649444 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.650043 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.650323 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.650630 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.651295 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 04:50:48.651599 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.653189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.665816 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1469/2933] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Sep 25 04:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 04:50:48.669850 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dad73d-e264-4908-9d4f-571ee96df6f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.679586 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dad73d-e264-4908-9d4f-571ee96df6f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.684220 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.684799 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.685074 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.685343 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.685969 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.687892 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.708485 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:48.718144 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1465/2934] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Sep 25 04:50:48 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:50:48.719799 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.729769 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eadeb2-0147-4687-9e36-e94ea41a9b41 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.754276 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:48.787555 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.788159 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.788439 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.788713 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.789364 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.791313 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.815567 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1470/2935] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Sep 25 04:50:48 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 04:50:48.816774 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.827237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c1eb-882f-435c-b2ee-963ccf27078e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.832092 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.832690 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.832993 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.833265 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.833907 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.835558 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.845927 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1466/2936] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:50:48.849576 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.859609 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714a510-2eae-44d8-8a82-7e0ff2681842 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.864766 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce0409-4ba1-4e04-8e9e-bac8673774c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.865354 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce0409-4ba1-4e04-8e9e-bac8673774c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.865638 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce0409-4ba1-4e04-8e9e-bac8673774c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.865921 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce0409-4ba1-4e04-8e9e-bac8673774c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.866591 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce0409-4ba1-4e04-8e9e-bac8673774c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.868174 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce0409-4ba1-4e04-8e9e-bac8673774c9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.879716 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1471/2937] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Sep 25 04:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 04:50:48.883525 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:48.893237 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af653b32-55ed-4b28-9544-cb6460b4dd34 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:48.897798 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:48.898465 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.898758 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.899014 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] PATH_INFO: `/v3/projects/3dba6f32de444314be41326e696f1f3c/users/feacba9846d548789fca10c12343cd81/roles/601168e670dd4cc8b74dc911848ac3e7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.913746 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dba6f32de444314be41326e696f1f3c, user_id=feacba9846d548789fca10c12343cd81, role_id=601168e670dd4cc8b74dc911848ac3e7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:48.916446 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:48.929313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1467/2938] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Sep 25 04:50:48 2022] PUT /identity/v3/projects/3dba6f32de444314be41326e696f1f3c/users/feacba9846d548789fca10c12343cd81/roles/601168e670dd4cc8b74dc911848ac3e7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:50:48.934184 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16aa81-8222-4e8c-9a03-0b8ce215a7b5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:48.934496 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16aa81-8222-4e8c-9a03-0b8ce215a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:48.934774 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16aa81-8222-4e8c-9a03-0b8ce215a7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:48.953374 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9d16aa81-8222-4e8c-9a03-0b8ce215a7b5 None None] MFA Rules not processed for user `5ce42dcf0646470a9a0e39f1ebd74dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:48.954658 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9d16aa81-8222-4e8c-9a03-0b8ce215a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:49.012289 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1472/2939] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:49.022310 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:49.024023 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:49.081350 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507a653-b0c2-451d-88dd-560d4d566116 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:49.085009 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:49.085622 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:49.085905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:49.086184 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:49.095663 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:49.097127 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:49.106519 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1468/2940] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:49.711307 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cf4d8-038f-4b81-b97d-df27be74349a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:49.711605 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cf4d8-038f-4b81-b97d-df27be74349a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:49.711876 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cf4d8-038f-4b81-b97d-df27be74349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:49.738815 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2e2cf4d8-038f-4b81-b97d-df27be74349a None None] MFA Rules not processed for user `feacba9846d548789fca10c12343cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:49.740033 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2e2cf4d8-038f-4b81-b97d-df27be74349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:49.807976 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1473/2941] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:49.819396 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:50:49.820794 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:49.877938 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8356-9054-49f2-8f24-ea880f4bef9a service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:50:49.881548 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655c67a-f2e7-4125-996d-0a22326d1fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f955275faf8349fc8d42068bd774ad10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:50:49.882150 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c67a-f2e7-4125-996d-0a22326d1fde service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:49.882458 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c67a-f2e7-4125-996d-0a22326d1fde service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:49.882729 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c67a-f2e7-4125-996d-0a22326d1fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:49.891298 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655c67a-f2e7-4125-996d-0a22326d1fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:50:49.893881 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655c67a-f2e7-4125-996d-0a22326d1fde service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:50:49.904731 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1469/2942] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:50:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:50:51.258760 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:50:51.259266 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:50:51.259389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:50:51.278623 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] MFA Rules not processed for user `feacba9846d548789fca10c12343cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:50:51.279828 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:50:51.287539 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1474/2943] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:50:59.900117 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:01.273134 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:06.096399 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0606f-0ce4-476d-be1e-4c24c0bb61b6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:06.096870 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0606f-0ce4-476d-be1e-4c24c0bb61b6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:06.096973 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0606f-0ce4-476d-be1e-4c24c0bb61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:06.115687 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8bf0606f-0ce4-476d-be1e-4c24c0bb61b6 None None] MFA Rules not processed for user `feacba9846d548789fca10c12343cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:51:06.116879 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8bf0606f-0ce4-476d-be1e-4c24c0bb61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:51:06.123764 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1470/2944] 10.222.0.52 () {58 vars in 958 bytes} [Sun Sep 25 04:51:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:51:07.671231 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:51:07.672721 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:51:07.684662 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6f731-f3d0-46f2-a9c9-5c6a2a30dd38 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:51:07.688421 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b066574-ba9b-4dc0-bf59-a0a359380438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:51:07.689092 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b066574-ba9b-4dc0-bf59-a0a359380438 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:07.689440 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b066574-ba9b-4dc0-bf59-a0a359380438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:07.689803 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b066574-ba9b-4dc0-bf59-a0a359380438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:07.692252 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0b066574-ba9b-4dc0-bf59-a0a359380438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:51:07.765958 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b066574-ba9b-4dc0-bf59-a0a359380438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:51:07.767513 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b066574-ba9b-4dc0-bf59-a0a359380438 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:51:07.778990 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1475/2945] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:51:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:51:09.094313 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0606f-0ce4-476d-be1e-4c24c0bb61b6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:51:09.104173 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0606f-0ce4-476d-be1e-4c24c0bb61b6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:51:09.107820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f75c3e044d4b0dbad6b16ea0599bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:51:09.108427 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:09.108709 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:09.108984 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:09.110820 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:51:09.124403 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:51:09.125996 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:51:09.138756 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1471/2946] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:51:17.773685 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=34 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:19.134133 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=9 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:20.875499 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054a20-887f-4007-85e4-3be6e3625e34 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:20.875975 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054a20-887f-4007-85e4-3be6e3625e34 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:20.876072 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054a20-887f-4007-85e4-3be6e3625e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:20.935970 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3b054a20-887f-4007-85e4-3be6e3625e34 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:51:20.937182 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3b054a20-887f-4007-85e4-3be6e3625e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:51:21.001331 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1476/2947] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Sep 25 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:51:21.047547 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:51:21.048985 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:51:21.142022 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8d947-9781-4bd7-a465-ac3a2b15041c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:51:21.148060 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:51:21.148670 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:21.148951 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:21.149236 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:21.158290 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:51:21.159905 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:51:21.168154 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1472/2948] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:51:30.998471 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=44 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:31.164825 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=41 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:35.573278 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424af89c-f86c-4b7e-81d7-b8c7c9047fc0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:35.573723 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424af89c-f86c-4b7e-81d7-b8c7c9047fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:35.573826 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424af89c-f86c-4b7e-81d7-b8c7c9047fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:35.593359 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-424af89c-f86c-4b7e-81d7-b8c7c9047fc0 None None] MFA Rules not processed for user `7edd6fd40289457d94e4ae4b7a26be80`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 04:51:35.594594 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-424af89c-f86c-4b7e-81d7-b8c7c9047fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:51:35.602298 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1477/2949] 10.222.0.52 () {58 vars in 967 bytes} [Sun Sep 25 04:51:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 04:51:35.614202 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:51:35.624652 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207b5fc-7fef-48dd-8de6-becc064b5cff service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:51:35.629621 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12819d6a0c19462d82b285502d0e27b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:51:35.630210 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:35.630527 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:35.630809 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:35.638646 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:51:35.640213 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:51:35.648535 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1473/2950] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Sep 25 04:51:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 04:51:37.544927 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424af89c-f86c-4b7e-81d7-b8c7c9047fc0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:51:37.557368 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424af89c-f86c-4b7e-81d7-b8c7c9047fc0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:51:37.562012 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:51:37.562675 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:37.562953 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:37.563250 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] PATH_INFO: `/v3/users/feacba9846d548789fca10c12343cd81` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:37.564891 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feacba9846d548789fca10c12343cd81)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:51:37.566948 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:51:37.616317 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feacba9846d548789fca10c12343cd81'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.623552 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feacba9846d548789fca10c12343cd81'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.624189 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feacba9846d548789fca10c12343cd81'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.624820 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feacba9846d548789fca10c12343cd81'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.632423 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feacba9846d548789fca10c12343cd81'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.650205 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1478/2951] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Sep 25 04:51:37 2022] DELETE /identity/v3/users/feacba9846d548789fca10c12343cd81 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:51:37.819020 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:51:37.830624 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b7aeb-b057-4dd3-8912-80aeff459690 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:51:37.892451 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ce42dcf0646470a9a0e39f1ebd74dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c69cf0e5d8493ba6bb16d3c4dd8b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:51:37.893079 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:51:37.893357 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:51:37.893630 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] PATH_INFO: `/v3/projects/3dba6f32de444314be41326e696f1f3c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:51:37.894785 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dba6f32de444314be41326e696f1f3c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:51:37.896686 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:51:37.941998 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dba6f32de444314be41326e696f1f3c', 'request_id': 'req-090af347-0653-44eb-b73b-f903a8202f29'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.947974 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dba6f32de444314be41326e696f1f3c', 'request_id': 'req-090af347-0653-44eb-b73b-f903a8202f29'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.956391 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dba6f32de444314be41326e696f1f3c', 'request_id': 'req-090af347-0653-44eb-b73b-f903a8202f29'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.966693 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] The token cache is being invalidate because project 3dba6f32de444314be41326e696f1f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 04:51:37.966978 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.967594 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090af347-0653-44eb-b73b-f903a8202f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 04:51:37.969080 dv-cinder-855359-5-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1474/2952] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Sep 25 04:51:37 2022] DELETE /identity/v3/projects/3dba6f32de444314be41326e696f1f3c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 04:51:47.646706 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:47.963664 dv-cinder-855359-5-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:54:04.513943 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 04:54:04.515389 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:54:04.642140 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956719e-ce01-43f7-b106-d373d8ec0124 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 04:54:04.698824 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eb5e0-9834-4057-a889-1adec9a48dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd8be65a664bba8a5b326943158418', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3700af4ec3340d4b08be7386c0cb969', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 04:54:04.699426 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eb5e0-9834-4057-a889-1adec9a48dcc service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 04:54:04.699707 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eb5e0-9834-4057-a889-1adec9a48dcc service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 04:54:04.700009 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eb5e0-9834-4057-a889-1adec9a48dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 04:54:04.701996 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-290eb5e0-9834-4057-a889-1adec9a48dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 04:54:04.713527 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eb5e0-9834-4057-a889-1adec9a48dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 04:54:04.715203 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eb5e0-9834-4057-a889-1adec9a48dcc service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 04:54:04.725006 dv-cinder-855359-5-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1479/2953] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Sep 25 04:54:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 04:54:14.720783 dv-cinder-855359-5-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=83 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}